-- Logs begin at Thu 2022-05-26 17:19:16 UTC, end at Thu 2022-05-26 18:39:39 UTC. -- May 26 18:08:25.079264 dv-cinder-843493-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 18:08:25.086639 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 18:08:25 2022] *** May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: nodename: dv-cinder-843493-1-iscsi May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: machine: x86_64 May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: clock source: unix May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: pcre jit disabled May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: detected number of CPU cores: 4 May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: current working directory: / May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: detected binary path: /usr/bin/uwsgi-core May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: your processes number limit is 47680 May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: your memory page size is 4096 bytes May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: detected max file descriptor number: 2048 May 26 18:08:25.089884 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: lock engine: pthread robust mutexes May 26 18:08:25.092458 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: thunder lock: enabled May 26 18:08:25.092458 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 18:08:25.092458 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 18:08:25.136835 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: Python main interpreter initialized at 0x556a8ee3c9c0 May 26 18:08:25.136835 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: python threads support enabled May 26 18:08:25.136835 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: your server socket listen backlog is limited to 100 connections May 26 18:08:25.136835 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: your mercy for graceful operations on workers is 90 seconds May 26 18:08:25.137240 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: mapped 403077 bytes (393 KB) for 2 cores May 26 18:08:25.137240 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: *** Operational MODE: preforking *** May 26 18:08:25.137518 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: *** uWSGI is running in multiple interpreter mode *** May 26 18:08:25.137518 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: spawned uWSGI master process (pid: 103224) May 26 18:08:25.137747 dv-cinder-843493-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 18:08:25.142070 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: spawned uWSGI worker 1 (pid: 103225, cores: 1) May 26 18:08:25.142070 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: spawned uWSGI worker 2 (pid: 103226, cores: 1) May 26 18:08:25.142070 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 18:08:26.335385 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 18:08:26.336959 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 18:08:27.070199 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:08:27.070199 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: from cryptography.utils import int_from_bytes May 26 18:08:27.070532 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:08:27.070532 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: from cryptography.utils import int_from_bytes May 26 18:08:27.074399 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:08:27.074399 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: from cryptography.utils import int_from_bytes May 26 18:08:27.074737 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:08:27.074737 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: from cryptography.utils import int_from_bytes May 26 18:08:29.719882 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:08:29.720461 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:08:29.722320 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:08:29.722320 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:08:29.722320 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:08:29.722320 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.722320 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.722320 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.722753 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.722951 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.723269 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.723425 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:08:29.724053 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.724173 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:08:29.724270 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.724352 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:08:29.724429 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.724506 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.724590 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:08:29.724786 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.724876 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:08:29.725124 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843493-1-iscsi {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.725217 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.725456 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.725544 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.725795 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.725909 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.726117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.726237 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.726444 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.726541 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.726754 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.726839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.727073 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.727156 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.727422 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.727528 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.727943 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.728112 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.728357 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.728520 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.728716 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.728906 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.729095 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.729234 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843493-1-iscsi {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.729348 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.729497 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.729666 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.730918 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731060 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731168 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731271 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731374 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731489 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731597 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731709 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731814 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731901 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731901 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.731901 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.732204 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.732292 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.732438 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843493-1-iscsi {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.732572 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.732770 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.732855 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.733094 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.733223 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.733418 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.733513 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.733754 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.733936 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.734063 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.734194 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.734387 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.734518 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.734697 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.734829 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.735091 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843493-1-iscsi {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.735194 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.735406 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.735517 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.735719 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.735860 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.736035 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.736183 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.736417 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.736564 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.736739 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.736886 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.737047 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.737189 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.737364 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.737508 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.737677 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.737841 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.738007 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.738142 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.738333 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.738470 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.738639 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.738771 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.738918 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.739052 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.739197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.739331 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.739512 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.739647 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.739831 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.739965 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.740139 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.740276 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.740412 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.740544 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.740686 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.740829 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.740977 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.741113 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.741265 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.741411 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.741570 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.741719 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.741909 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.742045 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.742224 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.742369 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.742521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.742665 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.742803 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.743437 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.743580 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.743784 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.744058 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.744171 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.744416 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.744515 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.744747 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.744850 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.745069 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.745163 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.745399 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.745495 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.745707 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.745851 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.746039 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.746142 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.746348 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.746442 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.746653 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.746767 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.746959 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.747052 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.747277 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.747380 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.747589 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.747693 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.747909 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.748006 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.748217 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.748308 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.748535 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.748635 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.748862 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.748952 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.749167 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.749257 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.749472 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.749571 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.749817 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.749910 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.750138 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.750228 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.750447 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.750553 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.750702 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.750799 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.751009 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.751096 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.751322 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.751412 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.751649 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.751742 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.751951 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.752040 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.752260 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.752347 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.752574 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.752660 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.752880 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.752973 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.753132 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.753217 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.753430 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.753518 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.753750 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.753853 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.754090 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.754220 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.754379 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.754465 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.754684 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.754780 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.754990 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.755075 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.755290 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.755385 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.755594 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.755697 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.755903 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.756000 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.756211 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.756301 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.756519 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.756635 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.756823 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.756917 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.757126 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.757213 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.757433 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.757533 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.757750 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.757839 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.758059 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.758155 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.758377 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.758473 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.759318 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.759417 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.759640 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.759908 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.760013 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.760227 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.760322 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.760541 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.760638 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.760853 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.760957 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.761178 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.761265 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.761486 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.761572 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.761824 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.761929 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.762153 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.762247 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.762459 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.762543 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.762764 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.762859 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.763072 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.763164 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.763381 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.763464 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.763687 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.763782 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.763997 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.764083 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.764296 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.764381 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.764603 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.764703 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.764906 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.765004 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.765214 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.765314 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.765517 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.765610 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.765843 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.765934 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.766150 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.766240 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.766455 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.766556 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.766762 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.766869 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.767118 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.767211 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.767434 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.767528 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.767737 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.767823 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.768055 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.768140 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.768378 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.768466 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.768691 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.768784 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.768995 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.769090 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.769301 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.769394 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.769620 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:08:29.769707 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.769979 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.770080 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.770312 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.770400 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.770638 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.770731 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.770959 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.771053 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.771286 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.771372 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.771612 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.771696 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.771927 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.772020 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.772239 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.772332 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.772553 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.772639 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.772877 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.772971 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.773185 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.773280 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.773494 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.773581 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.773826 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.773918 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.774176 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.774267 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.774545 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.774663 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.774901 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.775199 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.775307 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.775524 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.775612 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.775847 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.775944 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.776170 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.776257 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.776485 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.776578 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.776808 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.776931 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.777122 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.777238 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.777450 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.777541 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.777781 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.777876 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.778126 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.778227 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.778452 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.778538 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.778769 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.778863 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.779087 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.779182 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.779405 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.779493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.779716 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.779803 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.780027 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.780158 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.780338 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.780432 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.780660 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.780748 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.780992 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.781080 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.781289 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.781384 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.781606 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.781694 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.781943 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.782031 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.782256 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.782354 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.782566 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.782654 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.782874 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.782961 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.783183 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.783282 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.783492 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.783578 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.783809 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.783897 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.784120 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.784215 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.784431 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.784527 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.784747 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.784840 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.785061 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.785177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.785367 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.785456 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.785677 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.785783 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.786008 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.786098 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.786314 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.786403 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.786618 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.786707 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.786927 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.787035 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.787228 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.787341 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.787548 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.787645 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.787859 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.787960 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.788164 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.788260 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.788495 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.788594 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.788800 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.788886 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.789110 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.789196 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.789419 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.789526 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.789741 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.789864 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.790174 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.790567 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.790920 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.791121 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.791219 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.791325 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.791534 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.791621 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.791855 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.791950 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.792190 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.792277 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.792514 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.792602 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.792836 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.792935 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.793157 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.793251 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.793464 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.793550 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.793829 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.793921 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.794166 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.794252 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.794476 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.794560 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.794789 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.794886 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.795101 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.795188 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.795416 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.795505 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.795728 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.795813 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.796038 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.796133 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.796349 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.796475 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.796666 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.796754 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.796979 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.797085 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.797286 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.797389 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.797596 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.797693 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.797935 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.798027 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.798240 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.798343 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.798551 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.798643 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.798854 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.798945 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.799159 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.799259 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.799464 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.799554 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.799771 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.799860 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.800070 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.800169 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.800376 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.800467 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.800680 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.800771 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.800982 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.801073 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.801285 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.801376 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.801606 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.801696 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.801939 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.802046 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.802244 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.802331 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.802547 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.802633 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.802854 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.802942 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.803195 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.803281 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.803498 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.803593 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.803840 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.803929 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.804175 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.804261 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.804492 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.804586 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.804806 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.804939 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.805115 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.805201 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.806090 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.806255 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.806341 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.806529 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.806670 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.806874 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.806961 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.807190 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.807287 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.807505 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.807591 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.807829 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.807938 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.808139 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.808236 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.808462 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.808548 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.808773 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.808858 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.809099 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.809188 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.809411 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.809546 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.809774 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.809880 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.810052 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.810138 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.810367 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.810453 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.810682 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.810778 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.811008 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.811112 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.811324 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.811411 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.811644 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.811738 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.811956 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.812049 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.812268 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.812353 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.812577 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.812672 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.812886 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.812969 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.813195 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.813282 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.813512 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.813600 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.813854 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.813942 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.814174 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.814259 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.814500 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.814589 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.814816 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.814904 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.815131 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.815225 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.815447 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.815535 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.815762 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.815856 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.816070 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.816161 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.816382 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.816477 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.816704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.816787 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.817015 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.817113 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.817332 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.817424 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.817639 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.817736 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.817984 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.818094 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.818292 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.818378 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.818599 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.818691 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.818905 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.819002 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.819207 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.819300 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.819512 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.819598 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.819821 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.819924 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.820133 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.820220 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.820440 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.820526 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.820747 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.820842 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.821139 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.821832 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.822000 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.822209 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.822307 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.822615 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.822701 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.822926 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.823020 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.823233 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.823332 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.823557 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.823653 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.823884 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.823970 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.824197 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.824295 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.824515 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.824601 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.824844 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.824958 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.825149 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.825246 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.825456 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.825555 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.825803 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.825896 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.826117 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.826206 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.826423 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.826510 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.826728 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.826815 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.827031 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.827128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.827375 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.827470 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.827686 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.827780 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.827996 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.828106 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.828309 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.828413 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.828627 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.828717 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.828936 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.829037 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.829249 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.829348 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.829558 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.829658 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.829891 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.829983 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.830210 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.830302 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.830522 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.830625 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.830832 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.831103 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.831254 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.831444 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.831549 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.831756 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.831853 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.832067 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.832163 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.832389 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.832477 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.832695 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.832783 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.833004 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.833090 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.833318 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.833418 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.833622 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.833709 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.833959 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.834057 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.834276 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.834364 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.834619 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.834847 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.834952 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.835180 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.835267 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.835497 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.835598 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.835814 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.835909 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.836128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.836223 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.836442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.836537 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.836828 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.836930 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.837293 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.837380 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.837610 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.837857 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.837964 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.838176 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.838276 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.838492 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.838580 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.838802 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.838900 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.839109 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.839197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.839422 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.839517 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.839730 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.839826 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.840037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.840128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.840343 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.840429 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.840653 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.840748 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.840958 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.841045 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.841261 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.841348 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.841565 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.841655 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.841894 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.841982 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.842212 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.842331 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.842516 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.842648 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.842827 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.842962 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.843132 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.843296 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.843460 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.843610 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.843768 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.843923 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.844071 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.844237 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.844372 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.844555 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.844675 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.844871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.845015 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.845188 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.845319 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.845508 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.845655 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.845854 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.846008 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.846173 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.846349 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.846491 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.846657 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.846804 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.846962 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.847120 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.847287 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.847432 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.847591 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.847752 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.847894 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.848069 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.848263 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.848372 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.848505 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.848677 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.848812 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.848994 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.849116 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.849306 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.849430 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.849614 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.849753 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.849956 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.850091 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.850268 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.850355 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.850591 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.850692 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.850901 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.850990 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.851211 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.851299 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.851522 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.851610 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.851827 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.851912 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.852131 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.852219 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.852978 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.853066 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.853311 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.853580 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.853762 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.853953 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.854085 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.854264 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.854397 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.854577 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.854713 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.854883 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.855027 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.855201 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.855338 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.855509 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.855659 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.855815 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.855992 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.856119 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.856316 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.856428 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.856626 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.856721 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.856941 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.857068 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.857253 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.857350 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.857563 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.857765 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.857902 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.857989 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.858216 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.858317 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.858532 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.858665 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.858828 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.858915 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.859132 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.859218 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.859440 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.859528 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.859749 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.859834 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.860066 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.860189 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.860370 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.860458 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.860675 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.860767 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.860977 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.861061 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.861279 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.861366 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.861582 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.861676 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.861915 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.862021 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.862220 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.862307 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.862523 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.862616 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.862826 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.862923 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.863127 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.863222 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.863429 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.863516 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.863750 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.863844 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.864062 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.864149 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.864366 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.864451 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.864668 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.864764 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.864970 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.865058 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.865316 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.865401 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.865618 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.865716 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.865958 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.866059 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.866284 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.866374 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.866601 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.866690 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.866914 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.866998 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.867225 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.867311 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.867535 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.867623 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.867844 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.867932 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.868759 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.868902 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.869080 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.869283 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.869401 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.869604 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.869720 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.869948 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.870052 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.870258 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.870346 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.870563 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.870649 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.870890 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.870987 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.871202 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.871289 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.871513 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.871600 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.871837 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.871925 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.872161 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.872246 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.872471 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.872555 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.872774 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.872868 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.873082 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.873170 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.873388 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.873473 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.873696 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.873850 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.874035 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.874122 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.874341 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.874437 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.874649 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.874735 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.874956 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.875049 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.875268 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.875364 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.875578 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.875707 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.875885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.876027 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.876190 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.876345 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.876497 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.876655 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.876803 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.876973 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.877105 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.877292 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.877424 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.877615 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.877709 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.877963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.878069 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.878275 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.878363 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.878616 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.878699 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.878923 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.879018 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.879224 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.879312 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.879607 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.879692 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.879919 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.880018 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.880240 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.880342 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.880539 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.880624 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.880846 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.880945 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.881160 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.881309 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.881452 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.881568 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.881779 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.881867 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.882097 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.882184 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.882407 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.882515 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.882735 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.882823 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.883123 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.883206 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.883432 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.883520 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.883826 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.883915 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.884326 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.884419 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.884649 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.884735 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.884974 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.885061 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.885305 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.885397 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.885610 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.885705 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.885942 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.886029 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.886267 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.886365 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.886573 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.886669 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.886889 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.886975 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.887221 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.887306 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.887552 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.887722 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.887871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.887958 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.888191 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.888300 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.888505 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.888593 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.888836 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.888936 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.889166 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.889255 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.889487 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.889575 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.889842 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.889948 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.890148 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.890267 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.890463 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.890602 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.890771 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.890920 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.891094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.891250 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.891417 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.891583 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.891727 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.891897 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.892038 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.892208 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.892342 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.892523 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.892664 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.892834 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.892988 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.893147 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.893300 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.893478 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.893621 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.893816 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.894071 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.894159 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.894394 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.894502 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.894702 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.894789 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.895022 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.895110 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.895344 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.895444 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.895646 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.895731 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.895949 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.896035 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.896256 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.896355 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.896560 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.896647 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.896861 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.896948 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.897182 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.897278 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.897485 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.897608 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.897819 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.897909 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.898131 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.898229 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.898436 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.898524 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.898740 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.898828 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.899059 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.899248 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.899465 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.899552 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.899783 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.900110 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.900250 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.900444 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.900598 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.900763 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.900848 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.901092 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.901256 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.901410 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.901496 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.901718 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.901838 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.902070 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.902159 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.902381 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.902468 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.902686 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.902771 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.902989 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.903078 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.903293 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.903379 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.903604 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.903691 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.903916 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.904012 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.904227 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.904321 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.904540 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.904628 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.904859 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.904947 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.905166 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.905259 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.905472 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.905566 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.905804 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.905896 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.906139 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.906228 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.906453 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.906549 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.906777 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.906863 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.907079 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.907166 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.907381 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.907477 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.907688 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.907775 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.907989 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.908075 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.908291 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.908387 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.908592 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.908680 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.908896 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.908993 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.909196 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.909284 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.909496 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.909589 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.909824 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.909914 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.910148 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.910237 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.910452 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.910548 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.910771 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.910858 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.911081 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.911179 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.911381 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.911468 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.911683 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.911769 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.911983 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.912072 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.912321 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.912416 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.912623 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.912725 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.912954 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.913042 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.913269 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.913354 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.913588 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.913685 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.913936 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.914024 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.914239 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.914500 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.914589 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.915623 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.915771 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.915941 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.916265 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.916353 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.916689 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.916785 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.917009 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.917094 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.917327 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.917414 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.917644 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.917809 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.917987 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.918074 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.918296 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.918383 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.918611 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.918699 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.918922 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.919007 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.919239 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.919332 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.919578 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.919788 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.919922 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.920121 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.920243 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.920437 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.920563 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.920752 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.920883 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.921065 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.921202 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.921380 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.921566 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.921693 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.921917 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.922014 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.922234 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.922331 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.922553 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.922640 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.922876 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.922964 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.923197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.923285 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.923515 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.923601 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.923833 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.923919 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.924154 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.924249 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.924472 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.924566 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.924786 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.924873 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.925097 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.925184 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.925411 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.925505 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.925764 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.925868 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.926080 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.926167 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.926389 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.926474 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.926702 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.926798 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.927016 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.927111 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.927331 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.927419 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.927640 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.927736 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.927949 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.928165 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.928251 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.928488 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.928653 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.928830 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.928918 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.929142 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.929236 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.929452 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.929547 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.929783 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.929873 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.930109 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.930196 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.931035 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.931254 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.931476 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.931659 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.931849 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.932028 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.932202 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.932299 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.932381 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.932540 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.932777 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.933099 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.933390 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.933664 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.933785 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.933785 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.934020 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.934108 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.934186 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.934360 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.934588 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.934748 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.935341 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.935525 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.935620 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.935709 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.935791 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.935897 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.936114 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.936235 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.936426 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.936598 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.936737 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.936954 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.937043 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.937272 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.937362 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.937608 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.937694 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.937953 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.938092 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.938270 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.938367 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.938577 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.938662 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.938898 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.939107 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.939197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.939455 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.939543 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.939772 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.939857 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.940098 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.940187 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.940405 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.940499 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.940720 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.940807 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.941022 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.941108 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.941346 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.941434 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.941651 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.941766 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.941989 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.942090 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.942292 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.942380 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.942599 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.942698 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.942900 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.942987 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.943205 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.943293 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.943510 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.943606 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.943815 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.943900 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.944116 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.944201 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.944422 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.944527 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.944729 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.944815 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.945035 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.945120 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.945345 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.945441 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.945648 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.945765 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.945976 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.946586 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.946881 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.946978 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.947337 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.947423 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.947654 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.947749 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.947962 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.948092 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.948269 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.948359 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.948585 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.948671 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.948895 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.948983 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.949206 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.949293 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.949512 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.949599 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.949850 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.949940 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.950157 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.950243 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.950466 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.950728 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.950818 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.951069 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.951168 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.951421 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.951523 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.951712 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.951811 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.952027 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.952123 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.952336 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.952430 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.952657 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.952752 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.952966 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.953052 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.953277 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.953364 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.953588 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.953675 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.953932 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.954039 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.954248 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.954471 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.954559 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.954810 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.954896 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.955130 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.955214 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.955457 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.955544 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.955778 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.955863 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.956080 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.956164 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.956385 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.956480 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.956689 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.956774 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.956998 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.957094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.957303 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.957387 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.957611 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.957698 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.957943 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.958044 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.958252 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.958336 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.958557 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.958643 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.958863 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.958957 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.959169 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.959255 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.959473 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.959600 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.959781 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.959948 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.960086 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.960172 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.960391 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.960478 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.960697 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.960794 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.961000 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.961085 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.961308 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.961393 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.961662 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.961826 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.962629 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.962884 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.963203 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.963303 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.963532 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.963620 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.963851 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.963937 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.964164 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.964260 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.964477 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.964565 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.964795 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.964881 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.965106 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.965203 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.965422 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.965518 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.965775 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.965866 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.966085 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.966183 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.966392 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.966480 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.966768 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.966853 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.967104 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.967192 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.967421 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.967507 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.967734 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.967819 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.968039 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.968125 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.968357 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.968465 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.968676 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.968761 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.968985 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.969082 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.969295 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.969388 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.969603 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.969760 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.969993 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.970087 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.970259 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.970355 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.970574 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.970671 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.970886 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.970973 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.971197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.971290 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.971500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.971642 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.971805 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.971891 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.972112 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.972219 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.972425 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.972521 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.972729 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.972814 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.973032 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.973117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.973335 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.973423 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.973641 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.973756 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.973968 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.974054 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.974270 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.974359 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.974572 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.974658 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.974878 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.974972 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.975183 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.975271 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.975486 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.975570 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.975789 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.975874 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.976091 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.976179 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.976394 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.976489 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.976695 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.976792 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.976997 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.977092 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.977352 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.977457 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.977782 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.977926 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.978120 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.978377 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.978462 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.978689 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.978784 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.978999 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.979088 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.979307 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.979394 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.979640 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.979736 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.979980 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.980068 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.980323 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.980418 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.980609 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.980709 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.980922 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.981014 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.981247 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.981334 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.981557 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.981694 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.981904 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.981991 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.982234 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.982319 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.982550 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.982648 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.982860 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.982946 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.983179 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.983264 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.983489 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.983575 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.983802 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.983896 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.984115 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.984202 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.984425 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.984513 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.984739 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.984823 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.985046 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.985132 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.985361 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.985456 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.985688 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.985832 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.986018 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.986116 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.986344 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.986438 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.986666 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.986753 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.986980 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.987073 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.987293 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.987378 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.987605 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.987690 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.987935 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.988030 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.988245 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.988333 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.988553 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.988639 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.988868 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.988962 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.989178 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.989264 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.989491 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.989585 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.989830 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.989966 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.990095 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:08:29.990181 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.990457 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.990782 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.991091 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.991417 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.991742 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.992087 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.992399 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.992740 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.993153 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.993711 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.994053 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.994360 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:08:29.994607 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:08:30.050526 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Registered counter for database nova_api May 26 18:08:30.054380 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO dbcounter [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Registered counter for database nova_api May 26 18:08:30.073546 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:08:30.074820 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG oslo_db.sqlalchemy.engines [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:08:30.080425 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:08:30.081424 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writer thread running {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:08:30.138594 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.context [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),34292359-78bc-40ed-8211-94bb149a5ad8(cell1) {{(pid=103225) load_cells /opt/stack/nova/nova/context.py:464}} May 26 18:08:30.140033 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.context [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),34292359-78bc-40ed-8211-94bb149a5ad8(cell1) {{(pid=103226) load_cells /opt/stack/nova/nova/context.py:464}} May 26 18:08:30.142835 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:30.144249 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG oslo_concurrency.lockutils [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:30.144443 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:30.145245 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:30.145847 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG oslo_concurrency.lockutils [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:30.146638 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG oslo_concurrency.lockutils [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:30.147263 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:30.148608 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG oslo_concurrency.lockutils [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:30.149915 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Registered counter for database nova_cell0 May 26 18:08:30.151744 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO dbcounter [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Registered counter for database nova_cell0 May 26 18:08:30.154405 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Registered counter for database nova_cell1 May 26 18:08:30.155793 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO dbcounter [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Registered counter for database nova_cell1 May 26 18:08:30.162123 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:08:30.163354 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:08:30.166143 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG oslo_db.sqlalchemy.engines [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:08:30.168843 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG oslo_db.sqlalchemy.engines [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:08:30.170778 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:08:30.172345 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:08:30.173077 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writer thread running {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:08:30.313405 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writer thread running {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:08:30.321976 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Registered counter for database nova_cell0 May 26 18:08:30.324319 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO dbcounter [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Registered counter for database nova_cell0 May 26 18:08:30.331474 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:08:30.334857 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG oslo_db.sqlalchemy.engines [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:08:30.335963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:08:30.339931 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writer thread running {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:08:30.679342 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:08:30.682273 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: WARNING keystonemiddleware.auth_token [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:08:30.686942 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:08:30.689524 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: WARNING keystonemiddleware.auth_token [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:08:31.037098 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: WARNING keystonemiddleware.auth_token [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:08:31.037705 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:08:31.043919 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: WARNING keystonemiddleware.auth_token [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:08:31.044176 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:08:31.049224 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a8ee3c9c0 pid: 103226 (default app) May 26 18:08:31.049405 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a8ee3c9c0 pid: 103225 (default app) May 26 18:08:31.051357 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:31.052559 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-55992057-5837-4251-9dfe-4ca779e8cffb None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001791 May 26 18:08:31.052977 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu May 26 18:08:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:51.682233 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:51.684186 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002735 May 26 18:09:51.685072 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:09:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:51.706305 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_api:SELECT=3 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:51.708110 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_cell0:SELECT=3 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:51.709145 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_cell1:SELECT=3 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:51.711063 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:52.185546 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-a27305ba-68ab-4377-9996-f334b6a94d68 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:52.216890 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-a27305ba-68ab-4377-9996-f334b6a94d68 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.521489 May 26 18:09:52.217428 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1291 bytes} [Thu May 26 18:09:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:54.775073 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:54.776668 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-c6a9264f-1e0a-4958-b549-5a7f36d51d77 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002312 May 26 18:09:54.777277 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:09:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:54.870827 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-d5bd9cad-6d41-49b6-a0c0-d30e70dfb408 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:54.890440 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:09:54.890440 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: warnings.warn(msg) May 26 18:09:54.935375 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-d5bd9cad-6d41-49b6-a0c0-d30e70dfb408 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.148803 May 26 18:09:54.936317 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:09:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:09:55.160062 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-30b7af3a-0be3-4e1e-9672-3f918249025f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:55.163700 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:09:55.163700 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: warnings.warn(msg) May 26 18:09:55.168569 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:55.170086 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:55.172260 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell1:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:55.175183 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:55.247628 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-30b7af3a-0be3-4e1e-9672-3f918249025f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302565 May 26 18:09:55.248229 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 18:09:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:57.640906 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-d5bd9cad-6d41-49b6-a0c0-d30e70dfb408 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:57.642217 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-d5bd9cad-6d41-49b6-a0c0-d30e70dfb408 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 May 26 18:09:57.642906 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:09:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:09:57.777291 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-cdaa0c42-3bd6-4c71-8794-39271a0598cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "ds512M"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:57.798673 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:09:57.798673 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: warnings.warn(msg) May 26 18:09:57.821509 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-cdaa0c42-3bd6-4c71-8794-39271a0598cc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172369 May 26 18:09:57.822162 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:09:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:09:57.834439 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-fa38f2ce-6a36-45d6-8b2b-7fdb53bc5c66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:57.836031 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:09:57.836031 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: warnings.warn(msg) May 26 18:09:57.877818 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-fa38f2ce-6a36-45d6-8b2b-7fdb53bc5c66 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047388 May 26 18:09:57.878403 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 18:09:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:00.288540 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-cdaa0c42-3bd6-4c71-8794-39271a0598cc admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:00.291220 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-cdaa0c42-3bd6-4c71-8794-39271a0598cc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002554 May 26 18:10:00.291745 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:00 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:00.371542 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-e0964bd0-6d99-409b-b26f-57ec184c657e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:00.392611 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-e0964bd0-6d99-409b-b26f-57ec184c657e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094316 May 26 18:10:00.393284 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:10:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:10:00.406800 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a251f84e-de30-41d9-a79e-e73de24309c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:00.439900 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a251f84e-de30-41d9-a79e-e73de24309c6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036963 May 26 18:10:00.449799 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 18:10:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:02.823841 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-e0964bd0-6d99-409b-b26f-57ec184c657e admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:02.824876 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-e0964bd0-6d99-409b-b26f-57ec184c657e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 26 18:10:02.825274 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:02.893240 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-2cc841b4-fcc2-4d46-b275-7c196479cdb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:02.917162 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-2cc841b4-fcc2-4d46-b275-7c196479cdb2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085312 May 26 18:10:02.917875 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:10:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:10:02.930250 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c4bb87f4-48c1-4943-9593-52ea9312ca12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:02.956046 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-c4bb87f4-48c1-4943-9593-52ea9312ca12 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029623 May 26 18:10:02.956815 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 18:10:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:05.354371 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-2cc841b4-fcc2-4d46-b275-7c196479cdb2 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:05.355380 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-2cc841b4-fcc2-4d46-b275-7c196479cdb2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 26 18:10:05.356066 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:05.422531 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-1e95c3a6-e4a9-4da1-a613-1c9face67603 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "ram": 4096, "swap": 0, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:05.447334 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-1e95c3a6-e4a9-4da1-a613-1c9face67603 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084593 May 26 18:10:05.455055 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:10:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:10:05.461313 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-828f86f9-9793-4b40-b107-c6720f9e8f25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:05.486744 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-828f86f9-9793-4b40-b107-c6720f9e8f25 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029940 May 26 18:10:05.487470 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 18:10:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:07.870316 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-1e95c3a6-e4a9-4da1-a613-1c9face67603 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:07.871320 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-1e95c3a6-e4a9-4da1-a613-1c9face67603 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 May 26 18:10:07.871891 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:07.943298 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-5cd563bc-2971-4b6e-882d-169f46abc94e admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:07.967788 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-5cd563bc-2971-4b6e-882d-169f46abc94e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089279 May 26 18:10:07.968520 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1291 bytes} [Thu May 26 18:10:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:10.434970 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-1e95c3a6-e4a9-4da1-a613-1c9face67603 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:10.435988 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-1e95c3a6-e4a9-4da1-a613-1c9face67603 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 26 18:10:10.436432 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:10.526987 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-533556ca-ffa1-4bc0-a459-aebdc7b0dee8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:10.549917 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-533556ca-ffa1-4bc0-a459-aebdc7b0dee8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.107021 May 26 18:10:10.550574 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:10:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:10:10.563541 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-706b68a8-134b-4888-85f4-f0593d145a17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:10.590950 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-706b68a8-134b-4888-85f4-f0593d145a17 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031095 May 26 18:10:10.591691 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 18:10:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:13.271044 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-533556ca-ffa1-4bc0-a459-aebdc7b0dee8 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:13.273234 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-533556ca-ffa1-4bc0-a459-aebdc7b0dee8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003500 May 26 18:10:13.273885 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:13.361685 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-2a6c5a72-aabc-4439-87fd-d04dadc47077 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "disk": 20}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:13.382248 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-2a6c5a72-aabc-4439-87fd-d04dadc47077 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.101105 May 26 18:10:13.383146 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:10:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:10:13.398918 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4e903a7f-d416-42a9-b090-5a271ec3699c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:13.445205 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4e903a7f-d416-42a9-b090-5a271ec3699c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052812 May 26 18:10:13.446520 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 18:10:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:16.961952 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-2a6c5a72-aabc-4439-87fd-d04dadc47077 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:16.963009 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-2a6c5a72-aabc-4439-87fd-d04dadc47077 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 May 26 18:10:16.963412 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:17.033013 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-029ed759-71ad-4f42-b879-30f10c0d631b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "id": "3", "rxtx_factor": 1.0}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:17.052316 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-029ed759-71ad-4f42-b879-30f10c0d631b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081977 May 26 18:10:17.052878 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:10:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:10:17.065078 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-e0828391-3112-4a57-9981-08b0b0657912 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:17.093342 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-e0828391-3112-4a57-9981-08b0b0657912 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032161 May 26 18:10:17.094140 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 18:10:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:19.513759 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-029ed759-71ad-4f42-b879-30f10c0d631b admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:19.514854 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-029ed759-71ad-4f42-b879-30f10c0d631b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 May 26 18:10:19.515512 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:19.585649 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-9ab44b31-2771-432d-b0a8-595d53fcc0e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:19.611406 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-9ab44b31-2771-432d-b0a8-595d53fcc0e9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088856 May 26 18:10:19.612004 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:10:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:10:19.626288 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-f450ae06-924f-45e0-836a-81987e9e02b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:19.662236 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-f450ae06-924f-45e0-836a-81987e9e02b4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038601 May 26 18:10:19.663648 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 18:10:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:22.094774 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-9ab44b31-2771-432d-b0a8-595d53fcc0e9 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:22.096377 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-9ab44b31-2771-432d-b0a8-595d53fcc0e9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 May 26 18:10:22.096871 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:22.165331 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-47a3bc4c-b19c-4d6a-bcc5-3af9fb404ab7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "id": "5"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:22.185954 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-47a3bc4c-b19c-4d6a-bcc5-3af9fb404ab7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080188 May 26 18:10:22.186854 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 18:10:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:10:22.200918 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-49c3a138-3413-4191-88c8-8932597e4fd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:22.205154 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:22.239290 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-49c3a138-3413-4191-88c8-8932597e4fd2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043223 May 26 18:10:22.257570 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 18:10:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:46.106466 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-47a3bc4c-b19c-4d6a-bcc5-3af9fb404ab7 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:46.107571 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-47a3bc4c-b19c-4d6a-bcc5-3af9fb404ab7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 May 26 18:10:46.107967 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:10:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:46.184373 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-02fe9ed3-a2ce-4f4d-9617-4a271d9224ef admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:46.201468 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-02fe9ed3-a2ce-4f4d-9617-4a271d9224ef admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.087166 May 26 18:10:46.202034 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1291 bytes} [Thu May 26 18:10:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:47.218632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-47a3bc4c-b19c-4d6a-bcc5-3af9fb404ab7 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:47.219677 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-47a3bc4c-b19c-4d6a-bcc5-3af9fb404ab7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 26 18:10:47.220083 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:10:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:47.415813 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-3d0d742d-c016-4d79-afac-a314fc5633f3 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:47.421563 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.wsgi [None req-3d0d742d-c016-4d79-afac-a314fc5633f3 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-3d0d742d-c016-4d79-afac-a314fc5633f3 admin admin] Request method failure captured: May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Accept: application/json May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Accept-Encoding: gzip, deflate May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Connection: keep-alive May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Content-Length: 0 May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Host: 10.222.0.46 May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Openstack-Api-Version: compute 2.90 May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Openstack-System-Scope: None May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: User-Agent: python-novaclient May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Auth-Token: gAAAAABij8KnAVCqQmhkNyJ2Rwd9AstU_B8WCyvQEX4KIsta0Eqhwknm-69wtIpxB65v2u6u2-vklFfCGpdoazfBRStOmZt6gVvnAAzRianB-bJipoos88L2j9l9YdaelyQ4rN7RJev-nofFXiChoBL7nAFTQHaFVwZiFtyRpg3tDyQGe0f82q0 May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Domain-Id: None May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Domain-Name: None May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Identity-Status: Confirmed May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Is-Admin-Project: True May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Openstack-Nova-Api-Version: 2.90 May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Domain-Id: default May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Domain-Name: Default May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Name: admin May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Role: admin,member,reader May 26 18:10:47.424839 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Roles: admin,member,reader May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bbbdb1cacacf4ba5a41a00d6d478efbe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant: admin May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant-Name: admin May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User: admin May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Domain-Id: default May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Domain-Name: Default May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Id: 3b98d845867d491c91aeca1e12cf3ace May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Name: admin May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: method: > May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: exception: Flavor 42 could not be found. May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: action_args: {'id': '42'} May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:47.427493 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:47.428490 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:47.429704 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-3d0d742d-c016-4d79-afac-a314fc5633f3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:47.430959 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-3d0d742d-c016-4d79-afac-a314fc5633f3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062431 May 26 18:10:47.430959 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu May 26 18:10:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 18:10:47.436745 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-8eee4b33-bf16-46ce-9309-b463d311b1bb admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:47.439635 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:47.460147 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-8eee4b33-bf16-46ce-9309-b463d311b1bb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027141 May 26 18:10:47.460699 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 18:10:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:47.470561 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-56a7aa8b-805f-4890-aea1-b7c4de14f66b admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:47.492220 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-56a7aa8b-805f-4890-aea1-b7c4de14f66b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025215 May 26 18:10:47.492760 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 18:10:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:47.502053 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-e93dddea-c038-431a-a81b-e057ad2e640a admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:47.509050 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-e93dddea-c038-431a-a81b-e057ad2e640a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-e93dddea-c038-431a-a81b-e057ad2e640a admin admin] Request method failure captured: May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Accept: application/json May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Connection: keep-alive May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Content-Length: 0 May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Host: 10.222.0.46 May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABij8KnAVCqQmhkNyJ2Rwd9AstU_B8WCyvQEX4KIsta0Eqhwknm-69wtIpxB65v2u6u2-vklFfCGpdoazfBRStOmZt6gVvnAAzRianB-bJipoos88L2j9l9YdaelyQ4rN7RJev-nofFXiChoBL7nAFTQHaFVwZiFtyRpg3tDyQGe0f82q0 May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Domain-Id: None May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Domain-Name: None May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Name: admin May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Role: admin,member,reader May 26 18:10:47.512481 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Roles: admin,member,reader May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bbbdb1cacacf4ba5a41a00d6d478efbe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant: admin May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User: admin May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Id: 3b98d845867d491c91aeca1e12cf3ace May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Name: admin May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: method: > May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: exception: Flavor 42 could not be found. May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: action_args: {'id': '42'} May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:47.513928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:47.514871 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:47.516197 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-e93dddea-c038-431a-a81b-e057ad2e640a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:47.517394 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-e93dddea-c038-431a-a81b-e057ad2e640a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015389 May 26 18:10:47.517394 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu May 26 18:10:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 18:10:48.389548 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-56a7aa8b-805f-4890-aea1-b7c4de14f66b admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:48.390566 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-56a7aa8b-805f-4890-aea1-b7c4de14f66b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 26 18:10:48.390949 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:10:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:48.585003 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-55728633-457d-4987-8594-b0557263120b admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:48.591127 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-55728633-457d-4987-8594-b0557263120b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-55728633-457d-4987-8594-b0557263120b admin admin] Request method failure captured: May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Accept: application/json May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Connection: keep-alive May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Content-Length: 0 May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Host: 10.222.0.46 May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABij8Ko5U0nbwlMyjHIIKjuoE6VwPiJLNP3GI1cfGo4HxLv9E7AlHQFAC_fmJ1QoU5AzPg0ZgCZoIYwTFgxuS5AMUKuhdBXzS5PEZNAHFJqLtE79Kfneudz65LW7RYM3fWkwkCvuVGCWJG39Yhs4mKN4E3ZV5w6q7-7slVGjjOJyr4Wskc May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Domain-Id: None May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Domain-Name: None May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Name: admin May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Role: admin,member,reader May 26 18:10:48.592632 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Roles: admin,member,reader May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bbbdb1cacacf4ba5a41a00d6d478efbe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant: admin May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User: admin May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Id: 3b98d845867d491c91aeca1e12cf3ace May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Name: admin May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: method: > May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: exception: Flavor 84 could not be found. May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: action_args: {'id': '84'} May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:48.594117 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:48.594963 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:48.595981 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-55728633-457d-4987-8594-b0557263120b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:48.597016 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-55728633-457d-4987-8594-b0557263120b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062333 May 26 18:10:48.597016 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu May 26 18:10:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 18:10:48.604440 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-1a6863e4-cb19-465c-b587-6730cafcc5c0 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:48.621057 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-1a6863e4-cb19-465c-b587-6730cafcc5c0 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020119 May 26 18:10:48.621595 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 18:10:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:48.631748 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-1a638239-86d7-444e-ad47-5b6a420b08c2 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:48.646882 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-1a638239-86d7-444e-ad47-5b6a420b08c2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019251 May 26 18:10:48.647426 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 18:10:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:48.656603 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c025fc2d-2205-4a0c-8e6e-b40eb3f77f14 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:48.662547 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.wsgi [None req-c025fc2d-2205-4a0c-8e6e-b40eb3f77f14 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c025fc2d-2205-4a0c-8e6e-b40eb3f77f14 admin admin] Request method failure captured: May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Accept: application/json May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Accept-Encoding: gzip, deflate May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Connection: keep-alive May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Content-Length: 0 May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Host: 10.222.0.46 May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Openstack-Api-Version: compute 2.90 May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Openstack-System-Scope: None May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: User-Agent: python-novaclient May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Auth-Token: gAAAAABij8Ko5U0nbwlMyjHIIKjuoE6VwPiJLNP3GI1cfGo4HxLv9E7AlHQFAC_fmJ1QoU5AzPg0ZgCZoIYwTFgxuS5AMUKuhdBXzS5PEZNAHFJqLtE79Kfneudz65LW7RYM3fWkwkCvuVGCWJG39Yhs4mKN4E3ZV5w6q7-7slVGjjOJyr4Wskc May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Domain-Id: None May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Domain-Name: None May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Identity-Status: Confirmed May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Is-Admin-Project: True May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Openstack-Nova-Api-Version: 2.90 May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Domain-Id: default May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Domain-Name: Default May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Name: admin May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Role: admin,member,reader May 26 18:10:48.664094 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Roles: admin,member,reader May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bbbdb1cacacf4ba5a41a00d6d478efbe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant: admin May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant-Name: admin May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User: admin May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Domain-Id: default May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Domain-Name: Default May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Id: 3b98d845867d491c91aeca1e12cf3ace May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Name: admin May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: method: > May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: exception: Flavor 84 could not be found. May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: action_args: {'id': '84'} May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:48.665885 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:48.666822 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:48.668037 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c025fc2d-2205-4a0c-8e6e-b40eb3f77f14 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:48.669240 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-c025fc2d-2205-4a0c-8e6e-b40eb3f77f14 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012371 May 26 18:10:48.669240 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu May 26 18:10:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 18:10:49.547764 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-1a638239-86d7-444e-ad47-5b6a420b08c2 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.548766 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-1a638239-86d7-444e-ad47-5b6a420b08c2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 26 18:10:49.549160 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:49.740771 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-0b508e1c-1160-4eda-b649-195fde612e8c admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.746589 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.wsgi [None req-0b508e1c-1160-4eda-b649-195fde612e8c admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-0b508e1c-1160-4eda-b649-195fde612e8c admin admin] Request method failure captured: May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Accept: application/json May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Accept-Encoding: gzip, deflate May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Connection: keep-alive May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Content-Length: 0 May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Host: 10.222.0.46 May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Openstack-Api-Version: compute 2.90 May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Openstack-System-Scope: None May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: User-Agent: python-novaclient May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Auth-Token: gAAAAABij8KpfjwGtP42SNMf2eh4Wir6X2j2GVzFyAO5ghC-liTyxt1X6VqrtaZaefhQcokWH-Lng5I8sKOwzcZYDmGDjZd-IqVaAh1F_mrdvyuxZLPhUTHB3wdNbT-VEm6XoJ1OJBU3SabP0bLfXoe5YrVhSXelHCBYr2DMbXE-DWIWiSC0LuM May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Domain-Id: None May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Domain-Name: None May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Identity-Status: Confirmed May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Is-Admin-Project: True May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Openstack-Nova-Api-Version: 2.90 May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Domain-Id: default May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Domain-Name: Default May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Project-Name: admin May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Role: admin,member,reader May 26 18:10:49.748076 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Roles: admin,member,reader May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bbbdb1cacacf4ba5a41a00d6d478efbe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant: admin May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-Tenant-Name: admin May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User: admin May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Domain-Id: default May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Domain-Name: Default May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Id: 3b98d845867d491c91aeca1e12cf3ace May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: X-User-Name: admin May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: method: > May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: exception: Flavor 451 could not be found. May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: action_args: {'id': '451'} May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:49.749442 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:49.750500 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi May 26 18:10:49.752017 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-0b508e1c-1160-4eda-b649-195fde612e8c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:49.753289 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-0b508e1c-1160-4eda-b649-195fde612e8c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061518 May 26 18:10:49.753289 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 18:10:49.760524 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-30d92a01-645c-4c40-b8c6-a877392952ce admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.776385 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-30d92a01-645c-4c40-b8c6-a877392952ce admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019720 May 26 18:10:49.776939 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:49.789716 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.804962 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021376 May 26 18:10:49.805499 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:49.814808 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-75f6ede6-893e-4924-a953-22411f601b3d admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.821009 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-75f6ede6-893e-4924-a953-22411f601b3d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-75f6ede6-893e-4924-a953-22411f601b3d admin admin] Request method failure captured: May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Accept: application/json May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Connection: keep-alive May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Content-Length: 0 May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Host: 10.222.0.46 May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABij8KpfjwGtP42SNMf2eh4Wir6X2j2GVzFyAO5ghC-liTyxt1X6VqrtaZaefhQcokWH-Lng5I8sKOwzcZYDmGDjZd-IqVaAh1F_mrdvyuxZLPhUTHB3wdNbT-VEm6XoJ1OJBU3SabP0bLfXoe5YrVhSXelHCBYr2DMbXE-DWIWiSC0LuM May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Domain-Id: None May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Domain-Name: None May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Project-Name: admin May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Role: admin,member,reader May 26 18:10:49.822521 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Roles: admin,member,reader May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bbbdb1cacacf4ba5a41a00d6d478efbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bbbdb1cacacf4ba5a41a00d6d478efbe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant: admin May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant-Id: bbbdb1cacacf4ba5a41a00d6d478efbe May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User: admin May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Id: 3b98d845867d491c91aeca1e12cf3ace May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: X-User-Name: admin May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: method: > May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: exception: Flavor 451 could not be found. May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: action_args: {'id': '451'} May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:49.824177 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:49.825019 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi May 26 18:10:49.826128 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-75f6ede6-893e-4924-a953-22411f601b3d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:49.827229 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-75f6ede6-893e-4924-a953-22411f601b3d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012632 May 26 18:10:49.827229 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 18:10:50.699142 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:50.700146 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 26 18:10:50.700572 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:10:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:50.891281 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-89925b74-d2c6-4d20-a9ff-53e59552ca4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:50.909543 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-89925b74-d2c6-4d20-a9ff-53e59552ca4c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073489 May 26 18:10:50.910078 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu May 26 18:10:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:10:51.787694 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:51.788724 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 26 18:10:51.789114 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:10:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:51.983260 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-dfb0ff3e-64e5-4339-a3a1-3ca84a4b2d70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:52.001343 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-dfb0ff3e-64e5-4339-a3a1-3ca84a4b2d70 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069116 May 26 18:10:52.001874 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu May 26 18:10:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:10:52.891529 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:52.892648 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 26 18:10:52.893120 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:10:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:53.086134 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-11641a67-5418-41d0-85b2-776a91a116df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:53.105812 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-11641a67-5418-41d0-85b2-776a91a116df admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071660 May 26 18:10:53.106262 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu May 26 18:10:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:10:53.987425 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:53.988428 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 26 18:10:53.988928 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:10:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:54.182304 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a643c3ee-424c-4625-aba5-d96e2d7364b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:54.200635 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a643c3ee-424c-4625-aba5-d96e2d7364b5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070661 May 26 18:10:54.201107 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu May 26 18:10:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:10:55.102856 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:55.103855 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 26 18:10:55.104248 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:10:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:55.291680 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-70e1d765-227d-4847-8f0f-b9c6be853bb6 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:55.311458 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-70e1d765-227d-4847-8f0f-b9c6be853bb6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071341 May 26 18:10:55.312075 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu May 26 18:10:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:11:58.720938 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:58.721995 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-f6eb1a37-6696-45b6-8e42-ea09690ced29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 May 26 18:11:58.722399 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 18:11:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:58.735572 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:58.790739 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-1c8fff06-d7e5-4ba4-9f91-a43dd754590b admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:58.810317 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-1c8fff06-d7e5-4ba4-9f91-a43dd754590b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079790 May 26 18:11:58.810854 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1291 bytes} [Thu May 26 18:11:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:11:58.832354 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:58.836336 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-4e6a92fe-5032-4ae5-948c-94e79291b83c admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:58.844648 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-4e6a92fe-5032-4ae5-948c-94e79291b83c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013849 May 26 18:11:58.845796 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1282 bytes} [Thu May 26 18:11:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:58.857411 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-3b183b57-66d4-4f47-951f-d0c0aab5b34b admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:58.865283 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-3b183b57-66d4-4f47-951f-d0c0aab5b34b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011481 May 26 18:11:58.865819 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1285 bytes} [Thu May 26 18:11:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:58.876960 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:58.885699 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012294 May 26 18:11:58.886263 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1285 bytes} [Thu May 26 18:11:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:58.899718 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-afd7d606-9035-4340-8b76-564e242dec4f admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:58.907506 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-afd7d606-9035-4340-8b76-564e242dec4f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011386 May 26 18:11:58.908231 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1282 bytes} [Thu May 26 18:11:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:37.434339 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:37.435352 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 26 18:15:37.435746 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 35/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:37.591820 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=6 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:37.707208 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-83d53ce8-26e6-447a-9162-109f7d772877 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:37.708370 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:15:37.708370 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: warnings.warn(msg) May 26 18:15:37.709563 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-83d53ce8-26e6-447a-9162-109f7d772877 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.710054 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-83d53ce8-26e6-447a-9162-109f7d772877 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.710835 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-83d53ce8-26e6-447a-9162-109f7d772877 admin admin] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.711258 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-83d53ce8-26e6-447a-9162-109f7d772877 admin admin] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.745251 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-83d53ce8-26e6-447a-9162-109f7d772877 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155069 May 26 18:15:37.745826 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 35/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 18:15:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:15:38.628831 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:38.629874 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 26 18:15:38.630265 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:38.822431 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-858ee8da-3861-4635-9533-a15d40d5307a admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:38.823599 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:15:38.823599 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: warnings.warn(msg) May 26 18:15:38.825022 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-858ee8da-3861-4635-9533-a15d40d5307a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:38.825469 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-858ee8da-3861-4635-9533-a15d40d5307a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:38.826288 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-858ee8da-3861-4635-9533-a15d40d5307a admin admin] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:38.826723 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-858ee8da-3861-4635-9533-a15d40d5307a admin admin] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:38.846928 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-858ee8da-3861-4635-9533-a15d40d5307a admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076524 May 26 18:15:38.847413 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 36/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 18:15:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:15:50.156142 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:50.157136 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 May 26 18:15:50.157521 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 37/73] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:50.302682 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:50.303410 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell1:SELECT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:50.304016 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=8 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:50.354510 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-b75b5632-b1df-43a4-af8e-14cfc96eb3e7 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:50.355681 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:15:50.355681 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: warnings.warn(msg) May 26 18:15:50.356861 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b75b5632-b1df-43a4-af8e-14cfc96eb3e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:50.357300 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b75b5632-b1df-43a4-af8e-14cfc96eb3e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:50.358231 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b75b5632-b1df-43a4-af8e-14cfc96eb3e7 admin admin] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:50.358661 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b75b5632-b1df-43a4-af8e-14cfc96eb3e7 admin admin] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:50.387111 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-b75b5632-b1df-43a4-af8e-14cfc96eb3e7 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089207 May 26 18:15:50.387604 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 37/74] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 18:15:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:51.263843 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:51.264847 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-c1a28f0c-6682-4244-b9a0-1f6347cd76bf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 26 18:15:51.265391 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 38/75] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 18:15:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:51.459094 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-76df41aa-3eef-494b-80b6-a6170c6d12ab admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:51.460260 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:15:51.460260 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: warnings.warn(msg) May 26 18:15:51.461493 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-76df41aa-3eef-494b-80b6-a6170c6d12ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:51.461956 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-76df41aa-3eef-494b-80b6-a6170c6d12ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:51.462732 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-76df41aa-3eef-494b-80b6-a6170c6d12ab admin admin] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:51.463156 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-76df41aa-3eef-494b-80b6-a6170c6d12ab admin admin] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:51.484640 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-76df41aa-3eef-494b-80b6-a6170c6d12ab admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078656 May 26 18:15:51.485114 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 38/76] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 18:15:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:16:48.169710 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: Thu May 26 18:16:48 2022 - graceful shutdown triggered... May 26 18:16:48.170296 dv-cinder-843493-1-iscsi devstack@n-api.service[103226]: Gracefully killing worker 2 (pid: 103226)... May 26 18:16:48.169972 dv-cinder-843493-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 18:16:48.171154 dv-cinder-843493-1-iscsi devstack@n-api.service[103225]: Gracefully killing worker 1 (pid: 103225)... May 26 18:16:49.170530 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: worker 1 buried after 1 seconds May 26 18:16:49.170530 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: worker 2 buried after 1 seconds May 26 18:16:49.170530 dv-cinder-843493-1-iscsi devstack@n-api.service[103224]: goodbye to uWSGI. May 26 18:16:49.172138 dv-cinder-843493-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 18:16:49.172745 dv-cinder-843493-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 18:16:49.175637 dv-cinder-843493-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 18:16:49.188055 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 18:16:49 2022] *** May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: nodename: dv-cinder-843493-1-iscsi May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: machine: x86_64 May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: clock source: unix May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: pcre jit disabled May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: detected number of CPU cores: 4 May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: current working directory: / May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: detected binary path: /usr/bin/uwsgi-core May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: your processes number limit is 47680 May 26 18:16:49.205769 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: your memory page size is 4096 bytes May 26 18:16:49.207329 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: detected max file descriptor number: 2048 May 26 18:16:49.207329 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: lock engine: pthread robust mutexes May 26 18:16:49.207329 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: thunder lock: enabled May 26 18:16:49.207329 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 18:16:49.207329 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 18:16:49.255627 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: Python main interpreter initialized at 0x5577758819c0 May 26 18:16:49.255627 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: python threads support enabled May 26 18:16:49.255627 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: your server socket listen backlog is limited to 100 connections May 26 18:16:49.255627 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: your mercy for graceful operations on workers is 90 seconds May 26 18:16:49.256229 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: mapped 403077 bytes (393 KB) for 2 cores May 26 18:16:49.256229 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: *** Operational MODE: preforking *** May 26 18:16:49.256461 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: *** uWSGI is running in multiple interpreter mode *** May 26 18:16:49.256461 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: spawned uWSGI master process (pid: 117683) May 26 18:16:49.256535 dv-cinder-843493-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 18:16:49.257837 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: spawned uWSGI worker 1 (pid: 117696, cores: 1) May 26 18:16:49.257837 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: spawned uWSGI worker 2 (pid: 117697, cores: 1) May 26 18:16:49.257837 dv-cinder-843493-1-iscsi devstack@n-api.service[117683]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 18:16:50.918494 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 18:16:50.920002 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 18:16:51.726441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:16:51.726441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: from cryptography.utils import int_from_bytes May 26 18:16:51.726763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:16:51.726763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: from cryptography.utils import int_from_bytes May 26 18:16:51.728123 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:16:51.728123 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: from cryptography.utils import int_from_bytes May 26 18:16:51.728442 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:16:51.728442 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: from cryptography.utils import int_from_bytes May 26 18:16:54.221270 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:16:54.221270 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:16:54.221980 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:16:54.222116 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:16:54.222377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:16:54.222777 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.223115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.223445 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.223772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.224114 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.224437 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.224766 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.225096 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.225434 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.225703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.226054 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.226392 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843493-1-iscsi {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.226724 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.227042 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.227369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.227695 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.228060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.228386 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.228754 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.229268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.230629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.230629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.230629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.230993 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.231330 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.231649 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.231986 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.232292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.232625 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.234849 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.234849 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843493-1-iscsi {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.234849 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.234849 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.234849 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.234849 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.235322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.235322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.235740 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.235966 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.236325 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.236711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.237048 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.237383 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.237904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.238286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.238763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.239092 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.239428 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.239748 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.240066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.240328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.240647 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.240981 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.241315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.241649 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.241941 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.242205 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.242533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.242865 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.243185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.243500 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.243816 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.244129 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.244444 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.244759 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.245071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.245385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.245713 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.246058 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.246387 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.246701 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.247030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.247457 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.247702 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.248018 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.248368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.248698 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.249016 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.249346 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.249676 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.250019 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.250336 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.250652 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.250981 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.251316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.251629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.251889 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.252207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.252517 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.252843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.253168 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.254217 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.254554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.254873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.255192 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.255549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.255872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.256909 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.256909 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.256909 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.257277 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.257451 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.257795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.258131 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.258464 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.258866 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.259134 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.259456 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.259785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.260102 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.260419 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.265822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.265822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.265822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.265822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.265822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.265822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.265822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.265822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.266447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.266447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.266447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.266447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.266447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.266447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.266447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.266901 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:16:54.267296 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.267382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:16:54.267455 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.267455 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.267590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:16:54.267661 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.267738 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:16:54.267814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.267892 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:16:54.267970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268053 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268136 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268220 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268298 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268378 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268456 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268548 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268711 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268781 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.268924 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.270025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.270121 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.270194 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.270277 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.270350 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.270475 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.270581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.270750 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.270855 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.271073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.271188 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.271407 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843493-1-iscsi {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.271506 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.275305 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.275426 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.275521 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.275608 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.275693 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.275773 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.275853 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.275924 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.275994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.276084 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.276173 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.276257 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.276329 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.276413 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.276413 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.276552 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.276726 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.276810 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.276881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.276950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.276950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.277086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.277086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.277214 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.277283 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.277359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.277359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.277510 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.277585 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.277654 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.277722 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.278252 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.278407 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.278559 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.278703 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.278851 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.279005 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843493-1-iscsi {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.279155 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.279317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.279466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.279618 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.279760 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.279908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.280064 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.280206 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.280354 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.280506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.280649 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.280789 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.280942 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.281086 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.281247 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.281400 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.283940 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.284123 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.284504 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.284703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.284855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.285000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.285151 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.285344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.285494 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.285644 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.285835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.285982 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.286149 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.286303 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.286455 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.286598 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.286740 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.286882 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.287037 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.287180 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.287322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.287472 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.287622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.287781 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.287934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.288091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.288243 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.288391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.288850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.288850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.289149 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.289293 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.289293 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.289584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.289792 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.289956 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.290107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.290250 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.290391 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.290533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.290690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.290839 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.290981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.291121 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.291268 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.291416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.291573 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.291728 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.291871 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.292012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.292154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.292154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.292439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.292589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.292732 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.292881 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.293031 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.293180 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.293337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.293486 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.293656 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.294154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.294305 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.294305 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.294854 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.294854 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.295140 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.295290 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.295432 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.295581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.295724 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.295866 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.296031 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.296178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.296320 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.296470 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.296613 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.296753 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.296902 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.297044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.297192 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.297342 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.297491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.297643 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.297852 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.298021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.298175 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.298327 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.298470 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.298638 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.299021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.299189 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.299346 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.299500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.299757 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.299919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.300066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.300216 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.300376 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.300531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.300681 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.301018 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.301184 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.301339 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.301339 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.301627 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.301790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.301948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.302092 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.302233 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.302395 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.302552 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.302696 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.302837 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.302978 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.303126 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.303268 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.303422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.303565 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.303706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.303847 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.304279 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.304430 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.304594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.304752 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.304904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.304904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.305184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.305412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.305565 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.305709 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.305910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.306051 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.306198 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.306356 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.306356 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.306649 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.306805 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.306956 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.307105 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.307256 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.307406 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.307555 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.307707 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.307850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.307991 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.308140 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.308282 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.308431 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.308593 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.308743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.309148 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.309302 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.309454 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.309606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.309775 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.309925 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.310077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.310220 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.310369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.310522 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.310666 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.310824 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.310975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.311125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.311274 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.311426 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.311580 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.311724 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.311866 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.312008 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.312150 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.312304 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.312304 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.312585 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.312745 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.312889 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.313030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.313181 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.313324 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.313465 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.313614 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.320623 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.321406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.321574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.321776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.321945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.322265 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.322438 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.322587 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.322736 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.322888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:16:54.323044 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.323195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.323352 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.323503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.323654 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.323847 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.323997 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.324160 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.324344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.324799 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.324963 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.325107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.325251 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.325403 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.325556 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.325705 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.325872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.326031 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.326302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.326468 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.326635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.326798 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.326949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.327092 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.327243 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.327395 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.327538 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.327686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.327838 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.327987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.328145 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.328299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.328443 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.328596 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.328738 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.328887 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.329043 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.329192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.329342 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.329484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.329633 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.329818 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.329979 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.330129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.330273 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.330452 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.330806 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.330951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.331107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.331259 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.331457 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.332127 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.332318 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.332466 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.332617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.332761 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.332911 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.333054 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.333214 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.333367 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.333519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.333669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.333838 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.333980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.334134 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.334286 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.334437 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.334599 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.335060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.335219 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.335369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.335538 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.335691 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.335840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.335991 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.336133 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.336325 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.336551 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.336708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.336862 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.337006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.337147 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.337298 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.337441 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.337594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.337807 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.337957 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.338099 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.338258 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.338402 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.338551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.338694 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.338836 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.338985 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.339135 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.339278 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.339439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.339581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.339729 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.339872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.340026 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.340168 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.340310 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.340450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.340592 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.340927 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.341080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.341222 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.341371 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.341531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.341682 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.341861 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.342018 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.342161 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.342323 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.342476 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.342626 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.342852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.342998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.343148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.343299 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.343450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.343450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.343751 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.343913 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.344144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.344291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.344440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.344440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.344736 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.345185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.345337 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.345487 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.345636 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.345850 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.346019 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.346019 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.346300 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.346444 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.346684 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.346840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.347024 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.347251 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.347408 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.347553 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.347702 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.347855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.348018 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.348162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.348311 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.348454 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.348612 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.348756 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.348906 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.349056 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.349216 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.349367 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.349510 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.349659 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.349837 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.350000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.350153 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.350297 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.350297 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.350567 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.350567 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.350854 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.351089 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.351341 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.351490 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.351642 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.351787 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.351938 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.352092 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.352242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.352242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.352515 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.352656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.352811 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.352955 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.353105 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.353255 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.353398 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.353551 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.353704 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.353890 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.354054 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.354205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.354355 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.354499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.354655 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.354806 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.354949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.355416 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.355569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.355721 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.355873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.356023 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.356177 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.356346 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.357125 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.357294 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.357441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.357584 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.357766 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.357919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.358074 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.358231 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.358376 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.358519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.358700 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.358919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.359130 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.359332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.359554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.359796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.359997 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.360233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.360462 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.360690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.360912 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.361154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.361458 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.361665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.361937 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.361937 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.362492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.362710 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.362943 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.363179 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.363434 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.363673 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.363909 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.364145 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.364366 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.364570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.364807 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.365067 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.365810 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.366008 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.366158 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.366327 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.366477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.366619 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.366792 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.367035 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.367185 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.367345 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.367490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.367645 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.367788 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.367938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.368088 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.368240 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.368390 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.368533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.368675 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.368818 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.368976 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.369134 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.369278 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.369428 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.369589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.369771 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.369977 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.370173 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.370330 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.370480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.370631 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.370774 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.370929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.371080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.371230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.371374 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.371628 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.371796 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.371950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.372094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.372252 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.372404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.372665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.372827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.372972 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.373122 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.373265 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.373416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.373566 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.373738 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.373913 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.374058 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.374200 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.374348 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.374498 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.374650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.374794 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.374943 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.375087 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.375236 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.375404 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.375842 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.376002 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.376157 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.376319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.376463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.376615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.376767 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.376910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.377136 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.377284 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.377436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.377664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.377664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.377990 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.378146 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.378783 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.378932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.379089 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.379247 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.379397 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.379554 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.379748 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.379965 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.380133 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.380292 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.380450 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.380600 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.380770 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.380930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.381082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.381230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.381389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.381540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.381867 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.382042 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.382200 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.382350 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.382500 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.382667 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.382929 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.383109 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.383261 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.383418 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.383418 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.383723 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.383723 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.384030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.384183 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.384331 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.384331 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.384623 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.384779 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.384943 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.384943 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.385247 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.385247 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.385547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.386125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.386289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.386448 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.386599 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.386749 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.386905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.387065 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.387312 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.387476 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.387649 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.387808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.387966 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.388143 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.388301 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.388451 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.388600 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.388748 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.388903 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.389066 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.389227 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.389378 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.389547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.389705 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.389943 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.390095 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.390252 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.390409 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.390559 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.390717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.390879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.391030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.391179 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.391328 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.391477 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.391477 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.391808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.392048 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.392211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.392371 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.392520 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.392677 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.392841 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.393102 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.393260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.393420 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.393570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.393757 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.394546 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.394773 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.394962 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.395121 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.395280 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.395442 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.395606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.395792 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.396236 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.396406 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.396559 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.396716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.396885 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.397037 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.397200 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.397444 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.397603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.397812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.397981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.398132 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.398132 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.398436 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.398588 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.398736 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.398884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.399044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.399044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.399339 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.399488 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.399638 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.399787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.399942 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.400106 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.400256 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.400413 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.400569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.400728 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.400893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.401061 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.401212 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.401375 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.401527 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.401685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.401871 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.402041 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.402270 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.402425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.402582 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.402734 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.402896 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.403054 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.403321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.403477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.403635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.403793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.403959 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.404111 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.404267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.404426 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.404584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.404743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.404897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.405047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.405213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.405370 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.405520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.405678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.405858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.406031 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.406031 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.406581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.406743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.406904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.407056 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.407205 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.407361 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.407553 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.407698 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.407809 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.407898 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.407981 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408165 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408264 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408608 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408726 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408837 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.408961 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.409074 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.409193 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.409306 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.409451 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.409616 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.409782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.409902 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410024 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410024 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410235 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410344 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410823 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.410940 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411059 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411180 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411410 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411529 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411665 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411792 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.411904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.412120 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.412259 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.412454 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.412584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.412708 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.412818 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.412935 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.413053 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.413185 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.413331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.413536 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.413652 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.413793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.413926 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.414126 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.414241 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.414360 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.414471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.414581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.414698 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.414818 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.414938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415158 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415396 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415521 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415521 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415728 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.415967 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.416078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.416226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.416641 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.416760 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.416871 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.416987 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.417107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.417219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.417337 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.417456 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.417567 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.417699 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.417877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.417989 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418337 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418683 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418683 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418899 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.418899 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.419110 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.419236 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.419355 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.419716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.419830 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.419948 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420189 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420300 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420416 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420534 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.420999 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421117 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421227 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421336 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421452 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421563 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.421916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.422618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.422744 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.422867 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.422979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.423098 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.423218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.423329 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.423448 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.423578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.423794 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.424510 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.424648 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.424764 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.424890 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.425003 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.425156 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.425279 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.425391 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.425515 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.425640 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.425844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.425999 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.426113 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.426223 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.426343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.426769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.426769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427002 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427112 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427221 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427453 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427562 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427678 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427789 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.427923 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428055 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428174 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428286 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428402 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.428984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.429100 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.429211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.429335 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.429456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.429574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.429685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.429830 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.429945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430074 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430306 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430423 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430534 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430651 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430651 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.430986 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.431096 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.431212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.431332 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.431450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.431569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.431687 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.431805 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.431923 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.432112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.432227 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.432344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.432455 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.432562 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.432779 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.432904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.433016 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.433134 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.433252 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.433362 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.433485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.433611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.433721 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.433991 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.434114 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.434224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.434349 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.434461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.434592 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.434710 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.434820 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.434928 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.435047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.435197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.435314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.435431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.435549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.435549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.435782 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.435904 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.436022 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.436022 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.436237 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.436393 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.436393 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.436906 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437033 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437151 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437262 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437501 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437619 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437747 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.437998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.438153 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.438280 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.438400 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.438511 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.438628 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.438748 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.438860 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.438969 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439077 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439186 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439295 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439413 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439526 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439752 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439863 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.439973 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.440095 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.440207 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.440316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.440424 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.440424 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.440639 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.441262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.441381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.441491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.441600 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.441715 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.441866 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.441987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.442103 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.442213 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.442331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.442450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.442574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.442686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.442894 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443247 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443361 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443470 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443590 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443703 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.443966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.444214 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.444331 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.444441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.444559 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.444672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.444791 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.444910 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.445029 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.445141 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.445251 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.445369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.445490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.445490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.445711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.445880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.446042 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.446201 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.446354 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.446506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.446650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.447073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.447073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.447385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.447537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.447688 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.447833 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.447976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.448117 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.448269 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.448424 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.448568 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.448719 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.448872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.449015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.449167 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.449331 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.449482 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.449482 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.449805 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.449967 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.450113 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.450262 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.450406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.450556 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.450700 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.450989 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.451150 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.451303 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.451465 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.451609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.451752 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.451904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.452057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.452202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.452344 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.452487 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.452636 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.452788 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.453020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.453178 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.453178 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.453471 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.453629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.453821 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.453971 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.454114 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.454368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.454519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.454671 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.454816 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.454816 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.455093 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.455238 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.455391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.455613 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.455954 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.456104 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.456249 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.456457 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.457331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.457491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.457636 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.457808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.458084 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.458241 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.458403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.458561 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.458711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.458862 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.459014 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.459166 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.459383 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.459530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.459673 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.459822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.459976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.460127 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.460279 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.460431 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.460586 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.460729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.460884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.461111 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.461272 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.461425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.461425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.461697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.461923 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.462078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.462230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.462375 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.462531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.462675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.462817 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.462968 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.464015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.464175 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.464353 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.464610 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.464713 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.464802 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.464886 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.464977 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465173 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465354 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465448 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465535 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465638 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465741 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.465904 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466099 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466232 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466707 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466887 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.466981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.467067 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.467264 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.467486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.467583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.467682 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.467769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.467861 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.467947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468118 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468261 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468361 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468455 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468634 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468727 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.468904 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469003 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469090 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469187 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469285 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469378 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469464 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469640 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.469937 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470034 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470130 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470695 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470775 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470775 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470912 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.470985 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471098 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471176 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471176 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471176 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471176 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471514 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471618 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.471895 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472245 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472343 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472429 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472604 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472697 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472792 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472792 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.472957 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473048 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473523 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473598 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473681 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473681 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473873 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.473972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474194 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474276 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474553 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474553 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474739 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474832 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.474925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.475012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.475229 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.475335 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.475555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.475647 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.475877 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.475980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.476227 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.476536 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.476627 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.476860 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.476961 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.477180 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.477281 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.477519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.477720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.477846 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.478100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.478201 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.478425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.478533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.478756 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.478862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.479071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.479163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.479389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.479481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.479696 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.479803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.480012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.480102 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.480322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.480414 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.480632 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.480732 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.480943 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.481043 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.481256 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.481356 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.481565 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.481666 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.481899 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.481992 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.482215 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.482306 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.482530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.482634 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.482838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.482932 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.483150 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.483242 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.483483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.483598 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.483773 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.483863 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.484111 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.484208 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.484421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.484685 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.484791 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.485195 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.485323 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.485323 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.485476 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.485644 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.485792 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.485945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.486044 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.486285 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.486559 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.486737 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.486861 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.487070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.487178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.487397 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.487481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.487890 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.487998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.488288 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.488449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.488784 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.488885 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.489132 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.489222 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.489464 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.489564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.489802 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.489896 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.490115 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.490210 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.490444 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.490600 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.490758 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.491303 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.491461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.491605 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.491738 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.491880 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.492020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.492151 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.492287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.492418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.492557 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.492687 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.492687 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.492951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.493082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.493218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.493350 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.493497 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.493833 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.493973 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.494086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.494196 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.494315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.494427 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.494632 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.494788 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.494993 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.495112 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.495321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.495443 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.495641 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.495868 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.495988 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.496114 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.496254 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.496380 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.496569 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.496696 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.496882 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.497016 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.497202 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.497331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.497471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:16:54.497870 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.497870 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.498142 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.498495 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.498761 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.499074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.499384 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.499701 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.500046 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.500369 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.500691 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.501009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.501328 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.501643 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.501984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.502300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.502611 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.502928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.503846 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.504621 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.504941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.505381 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.505701 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.506054 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.506379 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.506692 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.507021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.507349 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.507672 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.507998 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.508795 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.509133 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.509481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.509843 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.510179 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.510492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.511587 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.511795 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.512113 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.512441 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.512758 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.513070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.513410 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.513792 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.514350 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.514667 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.514984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.515297 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.515610 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.515932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.516227 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.516537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.516852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.517570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.517570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.517782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.518086 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.518393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.518705 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.519650 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.520234 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.520591 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.520929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.521249 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.521580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.521928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.522259 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.522976 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.522976 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.523206 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.523527 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.523839 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.524178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.524490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.524803 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.525119 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.525433 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.527188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.527562 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.527917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.528266 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.528595 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.528941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.529274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.529609 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.529975 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.530298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.530953 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.530953 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.531256 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.531579 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.531897 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.532214 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.532534 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.532858 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.533192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.533527 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.533874 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.534213 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.534591 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.535169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.535575 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.535890 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.536228 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.536548 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.536866 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.537178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:16:54.537427 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:16:54.561360 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO dbcounter [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Registered counter for database nova_api May 26 18:16:54.583292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_db.sqlalchemy.engines [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:16:54.593406 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writer thread running {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:16:54.600056 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO dbcounter [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Registered counter for database nova_api May 26 18:16:54.622678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:16:54.631225 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writer thread running {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:16:54.654356 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.context [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),34292359-78bc-40ed-8211-94bb149a5ad8(cell1) {{(pid=117697) load_cells /opt/stack/nova/nova/context.py:464}} May 26 18:16:54.658795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:54.660650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:54.661303 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:54.663351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:54.665588 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO dbcounter [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Registered counter for database nova_cell0 May 26 18:16:54.669999 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO dbcounter [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Registered counter for database nova_cell1 May 26 18:16:54.678785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_db.sqlalchemy.engines [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:16:54.680385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_db.sqlalchemy.engines [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:16:54.685903 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writer thread running {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:16:54.690152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.context [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),34292359-78bc-40ed-8211-94bb149a5ad8(cell1) {{(pid=117696) load_cells /opt/stack/nova/nova/context.py:464}} May 26 18:16:54.695888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:54.697693 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:54.698534 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:54.700603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:54.702716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO dbcounter [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Registered counter for database nova_cell0 May 26 18:16:54.706894 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO dbcounter [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Registered counter for database nova_cell1 May 26 18:16:54.714359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:16:54.716796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:16:54.725564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writer thread running {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:16:54.725876 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writer thread running {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:16:54.835297 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writer thread running {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:16:54.845760 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO dbcounter [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Registered counter for database nova_cell0 May 26 18:16:54.853141 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_db.sqlalchemy.engines [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:16:54.858404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writer thread running {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:16:54.876778 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO dbcounter [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Registered counter for database nova_cell0 May 26 18:16:54.884863 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:16:54.890886 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writer thread running {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:16:55.193810 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: WARNING keystonemiddleware.auth_token [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:16:55.201654 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: WARNING keystonemiddleware.auth_token [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:16:55.215406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: WARNING keystonemiddleware.auth_token [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:16:55.223710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: WARNING keystonemiddleware.auth_token [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:16:55.566770 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: WARNING keystonemiddleware.auth_token [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:16:55.572807 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: WARNING keystonemiddleware.auth_token [None req-46d9b07b-d84e-40db-8810-2405b0439ff4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:16:55.578158 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577758819c0 pid: 117697 (default app) May 26 18:16:55.579073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: WARNING keystonemiddleware.auth_token [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:16:55.585641 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: WARNING keystonemiddleware.auth_token [None req-c9f4165f-8c6b-4608-a13c-a9722784090b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:16:55.590938 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577758819c0 pid: 117696 (default app) May 26 18:17:37.542834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:37.544370 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:37.547109 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:37.549817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:38.930943 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-96460511", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "networks": [{"uuid": "e7aa82ed-d0b7-4205-a028-23cbc2ce8ced"}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:17:40.060377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] validate_networks() for [('e7aa82ed-d0b7-4205-a028-23cbc2ce8ced', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:17:44.058042 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:17:44.058964 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:17:44.058964 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:17:44.059435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:17:44.060051 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:17:44.093463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:44.094516 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:44.097504 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:44.098959 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:44.184575 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Getting quotas for project 3f65ddb707cf4a3991b4797726d1336e. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:17:44.199479 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Getting quotas for user 02438387c012405eb258a65311c092a5 and project 3f65ddb707cf4a3991b4797726d1336e. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:17:44.224822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:17:44.231050 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:17:44.390409 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-96fe0ded-0d47-4eee-b0c3-bd507b94cd6f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.863235 May 26 18:17:44.391557 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 6866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:17:44.406557 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:44.407861 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:44.411355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:44.413092 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:45.129060 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2608985e-ecef-4e07-8a50-9b572f2ef202 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:45.129796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2608985e-ecef-4e07-8a50-9b572f2ef202 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:46.178925 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2608985e-ecef-4e07-8a50-9b572f2ef202 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:46.227876 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2608985e-ecef-4e07-8a50-9b572f2ef202 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1213 microversion: 2.1 time: 1.827666 May 26 18:17:46.238161 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:17:44 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1213 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:47.248142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ca8d0598-ec8a-4329-94d7-9f47950f91fc tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:47.250115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ca8d0598-ec8a-4329-94d7-9f47950f91fc tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:47.299530 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ca8d0598-ec8a-4329-94d7-9f47950f91fc tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:47.301349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ca8d0598-ec8a-4329-94d7-9f47950f91fc tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:47.305073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ca8d0598-ec8a-4329-94d7-9f47950f91fc tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:47.305868 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ca8d0598-ec8a-4329-94d7-9f47950f91fc tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:47.853476 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ca8d0598-ec8a-4329-94d7-9f47950f91fc tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:47.899728 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ca8d0598-ec8a-4329-94d7-9f47950f91fc tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1217 microversion: 2.1 time: 0.651059 May 26 18:17:47.901209 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:17:47 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1217 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:48.920698 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-15dfccff-aab2-451c-ae00-5ddef1656691 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:48.921567 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-15dfccff-aab2-451c-ae00-5ddef1656691 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:48.938061 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15dfccff-aab2-451c-ae00-5ddef1656691 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:48.939322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15dfccff-aab2-451c-ae00-5ddef1656691 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:48.941172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15dfccff-aab2-451c-ae00-5ddef1656691 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:48.945616 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15dfccff-aab2-451c-ae00-5ddef1656691 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:49.646711 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-15dfccff-aab2-451c-ae00-5ddef1656691 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:49.673850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-15dfccff-aab2-451c-ae00-5ddef1656691 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1265 microversion: 2.1 time: 0.759346 May 26 18:17:49.679143 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:17:48 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1265 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:50.313583 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9926f10b-bbda-467f-89f6-e63200c7fd56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: .version_select at 0x7f5f19a5cd30>, body: {"keypair": {"name": "tempest-keypair-650672944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDZxjYEgTriy8iAJi2kTLp3EgkBumGLWs11iHlYdzhMmthyoHry9eAjd06rkARUxF0D4bZH9gfHv0qDWWtL0Hzku+8+LBA1KMUbmrXTkusjQTMROZcfDFUznoZmQwuoeg=="}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:17:50.402724 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-9926f10b-bbda-467f-89f6-e63200c7fd56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:17:50.413757 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-9926f10b-bbda-467f-89f6-e63200c7fd56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for user 8da0a5a09a6041d68c5e445af1a492f3 and project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:17:50.525574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9926f10b-bbda-467f-89f6-e63200c7fd56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.632684 May 26 18:17:50.538113 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 3/5] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:17:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:17:50.701525 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7df68ecd-054a-4eab-ac9b-dd295c91b065 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:50.702391 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7df68ecd-054a-4eab-ac9b-dd295c91b065 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:50.729247 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7df68ecd-054a-4eab-ac9b-dd295c91b065 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:50.730897 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7df68ecd-054a-4eab-ac9b-dd295c91b065 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:50.733703 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7df68ecd-054a-4eab-ac9b-dd295c91b065 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:50.738488 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7df68ecd-054a-4eab-ac9b-dd295c91b065 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:51.276551 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7df68ecd-054a-4eab-ac9b-dd295c91b065 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:51.313840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7df68ecd-054a-4eab-ac9b-dd295c91b065 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1265 microversion: 2.1 time: 0.617543 May 26 18:17:51.331830 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:17:50 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1265 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:52.334382 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2c260075-8e99-4331-ab1a-4631dfea7b05 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:52.335171 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2c260075-8e99-4331-ab1a-4631dfea7b05 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:52.352254 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2c260075-8e99-4331-ab1a-4631dfea7b05 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:52.352708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2c260075-8e99-4331-ab1a-4631dfea7b05 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:52.363531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2c260075-8e99-4331-ab1a-4631dfea7b05 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:52.366946 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2c260075-8e99-4331-ab1a-4631dfea7b05 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:53.008157 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2c260075-8e99-4331-ab1a-4631dfea7b05 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:53.016479 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2c260075-8e99-4331-ab1a-4631dfea7b05 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1271 microversion: 2.1 time: 0.688486 May 26 18:17:53.038226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:17:52 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1271 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:54.043218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b28f5280-d83c-4eac-a34d-11bdaa4ec302 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:54.044121 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b28f5280-d83c-4eac-a34d-11bdaa4ec302 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:54.079734 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b28f5280-d83c-4eac-a34d-11bdaa4ec302 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:54.086025 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b28f5280-d83c-4eac-a34d-11bdaa4ec302 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:54.087511 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b28f5280-d83c-4eac-a34d-11bdaa4ec302 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:54.090290 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b28f5280-d83c-4eac-a34d-11bdaa4ec302 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:55.012560 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b28f5280-d83c-4eac-a34d-11bdaa4ec302 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:55.021969 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b28f5280-d83c-4eac-a34d-11bdaa4ec302 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.985463 May 26 18:17:55.022352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:17:54 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:17:56.043824 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-86db5c39-094e-4bff-b2a4-45fb9056ec31 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:56.044491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-86db5c39-094e-4bff-b2a4-45fb9056ec31 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:56.049365 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:56.088449 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-86db5c39-094e-4bff-b2a4-45fb9056ec31 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:56.090751 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-86db5c39-094e-4bff-b2a4-45fb9056ec31 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:56.094114 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-86db5c39-094e-4bff-b2a4-45fb9056ec31 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:56.094919 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-86db5c39-094e-4bff-b2a4-45fb9056ec31 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:56.815355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:57.194033 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-86db5c39-094e-4bff-b2a4-45fb9056ec31 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:57.217503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-86db5c39-094e-4bff-b2a4-45fb9056ec31 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 1.180679 May 26 18:17:57.218868 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:17:56 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:57.240082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1847168372", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a9ad5fd-79c8-4cd5-b5bd-a36ef382cf69"}], "security_groups": [{"name": "tempest-securitygroup--1662704821"}], "key_name": "tempest-keypair-650672944", "user_data": "}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:17:57.844762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] validate_networks() for [('8a9ad5fd-79c8-4cd5-b5bd-a36ef382cf69', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:17:57.937054 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-41335cda-7421-48c1-99d9-08b8acbbbb4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'create', calling method: .version_select at 0x7f5f1aada700>, body: {"keypair": {"name": "tempest-keypair-1732374166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEujKmdIuCbRoZ5cA/o+bCSWddp9AuRe63pWXHcJioYFjuv/ivKlaMx+X5WpqnZgNJcQpxRVTS8Sf5FIrUA/NvhIHguCLK0Sv5yNOWEX9bGN2GNFNTAo+ILSvqXxw+8qFg=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:17:58.087095 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-41335cda-7421-48c1-99d9-08b8acbbbb4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Getting quotas for project 0c2a09a6e81240889c49b5abb24ab225. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:17:58.115709 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-41335cda-7421-48c1-99d9-08b8acbbbb4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Getting quotas for user a20f6932d763461ea26c2d60ed58a59f and project 0c2a09a6e81240889c49b5abb24ab225. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:17:58.335104 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-41335cda-7421-48c1-99d9-08b8acbbbb4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.530857 May 26 18:17:58.344326 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 5/10] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:17:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:17:58.350717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1bb0ab47-8273-46b5-8454-ed43d9a63dab tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:58.351717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1bb0ab47-8273-46b5-8454-ed43d9a63dab tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:58.359380 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bb0ab47-8273-46b5-8454-ed43d9a63dab tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:58.360338 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bb0ab47-8273-46b5-8454-ed43d9a63dab tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:58.362339 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bb0ab47-8273-46b5-8454-ed43d9a63dab tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:58.363126 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1bb0ab47-8273-46b5-8454-ed43d9a63dab tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:59.053328 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1bb0ab47-8273-46b5-8454-ed43d9a63dab tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:59.085520 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1bb0ab47-8273-46b5-8454-ed43d9a63dab tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.736190 May 26 18:17:59.086260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:17:58 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:59.803584 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1367609350", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:00.073279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] validate_networks() for [('0c1d13cb-66bd-44a0-a8a3-bdb9797fb0f4', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:18:00.175746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:18:00.176187 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:18:00.176647 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:18:00.177065 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:18:00.177482 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:18:00.194340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:00.194857 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:00.195681 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:00.196118 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:00.261884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:18:00.277878 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for user 8da0a5a09a6041d68c5e445af1a492f3 and project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:18:00.330801 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:18:00.333463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:18:00.478612 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a333e39c-8929-4d9c-8125-0280ae35f61e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.255912 May 26 18:18:00.483631 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 6/12] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:17:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 3264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:18:00.491616 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a7413bbf-a940-4c2d-a42a-c0841596042e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:00.495331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a7413bbf-a940-4c2d-a42a-c0841596042e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:00.521950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7413bbf-a940-4c2d-a42a-c0841596042e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:00.523207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7413bbf-a940-4c2d-a42a-c0841596042e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:00.527093 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7413bbf-a940-4c2d-a42a-c0841596042e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:00.527769 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7413bbf-a940-4c2d-a42a-c0841596042e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:02.091325 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a7413bbf-a940-4c2d-a42a-c0841596042e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:02.102720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a7413bbf-a940-4c2d-a42a-c0841596042e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 1.615067 May 26 18:18:02.105594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:00 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:02.139066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-335a6943-b2a9-415a-bcc2-33ed7df2c44b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:02.141232 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-335a6943-b2a9-415a-bcc2-33ed7df2c44b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:02.474681 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-335a6943-b2a9-415a-bcc2-33ed7df2c44b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:02.498391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-335a6943-b2a9-415a-bcc2-33ed7df2c44b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1241 microversion: 2.1 time: 0.387822 May 26 18:18:02.512779 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 8/14] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:02 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1241 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:02.722260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:18:02.723477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:18:02.725102 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:18:02.725777 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:18:02.728268 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:18:02.768491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:02.768491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:02.768491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:02.768491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:02.801400 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Getting quotas for project 5cb09766b9784d50aad144d466a5d050. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:18:02.807527 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Getting quotas for user 3b3f8de4a3b54d58806506b827cfa89a and project 5cb09766b9784d50aad144d466a5d050. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:18:02.827576 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:18:02.832584 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:18:03.025678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0dfd8a6c-f997-4a7b-9bcd-22e41d2ea6b2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.546634 May 26 18:18:03.027147 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 7/15] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:17:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:18:03.037213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1defd688-d155-4b96-a2e4-5956c2917d0f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:03.037974 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1defd688-d155-4b96-a2e4-5956c2917d0f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:03.124216 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cac350b5-e11d-4f59-98d1-67737dbb8b65 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:03.125236 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cac350b5-e11d-4f59-98d1-67737dbb8b65 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:03.155866 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cac350b5-e11d-4f59-98d1-67737dbb8b65 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:03.170340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cac350b5-e11d-4f59-98d1-67737dbb8b65 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:03.172224 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cac350b5-e11d-4f59-98d1-67737dbb8b65 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:03.176355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cac350b5-e11d-4f59-98d1-67737dbb8b65 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:03.270203 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1defd688-d155-4b96-a2e4-5956c2917d0f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:03.285400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1defd688-d155-4b96-a2e4-5956c2917d0f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1222 microversion: 2.1 time: 0.251916 May 26 18:18:03.296768 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 9/16] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:03 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:03.529123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f22929e7-3bfe-48bd-83a6-338931ab75f3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:03.530154 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f22929e7-3bfe-48bd-83a6-338931ab75f3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:03.557558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f22929e7-3bfe-48bd-83a6-338931ab75f3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:03.588726 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f22929e7-3bfe-48bd-83a6-338931ab75f3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:03.589671 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f22929e7-3bfe-48bd-83a6-338931ab75f3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:03.590160 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f22929e7-3bfe-48bd-83a6-338931ab75f3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:03.870640 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f22929e7-3bfe-48bd-83a6-338931ab75f3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:03.880996 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f22929e7-3bfe-48bd-83a6-338931ab75f3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1293 microversion: 2.1 time: 0.356328 May 26 18:18:03.899237 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 10/17] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:03 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:03.931881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1534753457", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:04.099899 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] validate_networks() for [('0c1d13cb-66bd-44a0-a8a3-bdb9797fb0f4', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:18:04.664358 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cac350b5-e11d-4f59-98d1-67737dbb8b65 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:04.678048 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cac350b5-e11d-4f59-98d1-67737dbb8b65 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 1.556225 May 26 18:18:04.679163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 8/18] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:03 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:05.173519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-4ccb8f07-5860-4054-9fa6-263f9675d298 req-88287587-6be2-44dd-87f5-32f94b3fca56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e", "tag": "2ec1e990-e50a-44d3-aeb8-f9a33c92c72b"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:05.228216 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4ccb8f07-5860-4054-9fa6-263f9675d298 req-88287587-6be2-44dd-87f5-32f94b3fca56 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.228672 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4ccb8f07-5860-4054-9fa6-263f9675d298 req-88287587-6be2-44dd-87f5-32f94b3fca56 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.342789 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-4ccb8f07-5860-4054-9fa6-263f9675d298 req-88287587-6be2-44dd-87f5-32f94b3fca56 service nova] Creating event network-changed:2ec1e990-e50a-44d3-aeb8-f9a33c92c72b for instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e on hv-cinder-84349 May 26 18:18:05.346787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4ccb8f07-5860-4054-9fa6-263f9675d298 req-88287587-6be2-44dd-87f5-32f94b3fca56 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 18:18:05.354665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80967e3d-66cc-490e-826f-9f2d53fc9cdb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.356640 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80967e3d-66cc-490e-826f-9f2d53fc9cdb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.359321 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80967e3d-66cc-490e-826f-9f2d53fc9cdb None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.360368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80967e3d-66cc-490e-826f-9f2d53fc9cdb None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.396029 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.compute.rpcapi [None req-80967e3d-66cc-490e-826f-9f2d53fc9cdb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 18:18:05.397978 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80967e3d-66cc-490e-826f-9f2d53fc9cdb None None] Releasing lock "compute-rpcapi-router" {{(pid=117696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 18:18:05.441711 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-80967e3d-66cc-490e-826f-9f2d53fc9cdb None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.760436 May 26 18:18:05.442371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 9/19] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:05.448325 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-43ab2d83-d28f-463e-a24b-7e34dd97b75b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:05.449043 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-43ab2d83-d28f-463e-a24b-7e34dd97b75b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:05.459475 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-43ab2d83-d28f-463e-a24b-7e34dd97b75b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.460175 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-43ab2d83-d28f-463e-a24b-7e34dd97b75b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.461139 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-43ab2d83-d28f-463e-a24b-7e34dd97b75b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.461888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-43ab2d83-d28f-463e-a24b-7e34dd97b75b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.617544 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-43ab2d83-d28f-463e-a24b-7e34dd97b75b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:05.630182 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-43ab2d83-d28f-463e-a24b-7e34dd97b75b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1299 microversion: 2.1 time: 0.185823 May 26 18:18:05.630798 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 10/20] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:05 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:05.695351 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-817a50dc-57a9-42d7-8ebc-d45c0803a100 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:05.695907 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-817a50dc-57a9-42d7-8ebc-d45c0803a100 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:05.705751 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-817a50dc-57a9-42d7-8ebc-d45c0803a100 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.706236 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-817a50dc-57a9-42d7-8ebc-d45c0803a100 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.713560 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-817a50dc-57a9-42d7-8ebc-d45c0803a100 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.714423 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-817a50dc-57a9-42d7-8ebc-d45c0803a100 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.874892 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-817a50dc-57a9-42d7-8ebc-d45c0803a100 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:06.887000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-817a50dc-57a9-42d7-8ebc-d45c0803a100 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 1.192621 May 26 18:18:06.887652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 11/21] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:05 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:06.900846 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9584303a-57bb-40db-9ffd-0739c413972e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:06.901474 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9584303a-57bb-40db-9ffd-0739c413972e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:06.916168 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9584303a-57bb-40db-9ffd-0739c413972e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.921137 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9584303a-57bb-40db-9ffd-0739c413972e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.922168 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9584303a-57bb-40db-9ffd-0739c413972e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.922865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9584303a-57bb-40db-9ffd-0739c413972e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:07.086948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:18:07.088025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:18:07.088648 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:18:07.089391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:18:07.091088 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:18:07.103250 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:07.103762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:07.104869 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:07.105480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:07.124275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9584303a-57bb-40db-9ffd-0739c413972e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:07.144231 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9584303a-57bb-40db-9ffd-0739c413972e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1299 microversion: 2.1 time: 0.252723 May 26 18:18:07.145221 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 12/22] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:06 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:07.175427 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Getting quotas for project 5cb09766b9784d50aad144d466a5d050. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:18:07.183251 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Getting quotas for user 3b3f8de4a3b54d58806506b827cfa89a and project 5cb09766b9784d50aad144d466a5d050. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:18:07.215444 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:18:07.219115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:18:07.335543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-278ad5c1-ea63-4a88-8c14-56bbe3165480 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.435053 May 26 18:18:07.336397 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 11/23] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:18:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 3437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:18:07.348866 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-61a3d229-205a-49eb-a31d-3b2fc40a0d3d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:07.349664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-61a3d229-205a-49eb-a31d-3b2fc40a0d3d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:07.449992 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-61a3d229-205a-49eb-a31d-3b2fc40a0d3d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:07.462310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-61a3d229-205a-49eb-a31d-3b2fc40a0d3d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1222 microversion: 2.1 time: 0.117615 May 26 18:18:07.465633 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 13/24] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:07 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:07.906032 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-62dc833a-c0e5-4a09-bc45-f0d01e2bb8c0 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:07.907199 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-62dc833a-c0e5-4a09-bc45-f0d01e2bb8c0 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:07.909763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=10 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:07.922025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62dc833a-c0e5-4a09-bc45-f0d01e2bb8c0 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:07.928745 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62dc833a-c0e5-4a09-bc45-f0d01e2bb8c0 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:07.930011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62dc833a-c0e5-4a09-bc45-f0d01e2bb8c0 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:07.932049 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62dc833a-c0e5-4a09-bc45-f0d01e2bb8c0 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:07.943720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=37 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:08.164480 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e3b9e08a-2e28-427b-b2f9-598ffa33fa56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:08.165802 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e3b9e08a-2e28-427b-b2f9-598ffa33fa56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:08.173990 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e3b9e08a-2e28-427b-b2f9-598ffa33fa56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:08.174606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e3b9e08a-2e28-427b-b2f9-598ffa33fa56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:08.175755 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e3b9e08a-2e28-427b-b2f9-598ffa33fa56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:08.176335 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e3b9e08a-2e28-427b-b2f9-598ffa33fa56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:08.278808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-62dc833a-c0e5-4a09-bc45-f0d01e2bb8c0 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:08.291409 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-62dc833a-c0e5-4a09-bc45-f0d01e2bb8c0 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.389017 May 26 18:18:08.291921 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e3b9e08a-2e28-427b-b2f9-598ffa33fa56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:08.303306 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e3b9e08a-2e28-427b-b2f9-598ffa33fa56 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1299 microversion: 2.1 time: 0.142449 May 26 18:18:08.304226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 12/25] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:07 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:08.313666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 14/26] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:08 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:08.482311 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1df0ebc6-e9e6-4898-90ba-d9581775a7ca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:08.482935 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1df0ebc6-e9e6-4898-90ba-d9581775a7ca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:08.490714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1df0ebc6-e9e6-4898-90ba-d9581775a7ca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:08.491419 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1df0ebc6-e9e6-4898-90ba-d9581775a7ca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:08.492160 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1df0ebc6-e9e6-4898-90ba-d9581775a7ca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:08.492595 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1df0ebc6-e9e6-4898-90ba-d9581775a7ca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:08.566528 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1df0ebc6-e9e6-4898-90ba-d9581775a7ca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:08.581286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1df0ebc6-e9e6-4898-90ba-d9581775a7ca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1226 microversion: 2.1 time: 0.104285 May 26 18:18:08.582535 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:08 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:08.584768 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1815698239", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c7075e7-d3fe-46a2-a6e3-f88506cd300f"}], "security_groups": [{"name": "tempest-securitygroup--1361354382"}], "key_name": "tempest-keypair-1732374166", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:08.749378 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] validate_networks() for [('8c7075e7-d3fe-46a2-a6e3-f88506cd300f', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:18:09.183285 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:18:09.184969 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:18:09.185705 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:18:09.186730 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:18:09.188158 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:18:09.199419 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:09.199932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:09.200852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:09.204371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:09.225777 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Getting quotas for project 0c2a09a6e81240889c49b5abb24ab225. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:18:09.230368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Getting quotas for user a20f6932d763461ea26c2d60ed58a59f and project 0c2a09a6e81240889c49b5abb24ab225. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:18:09.244854 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:18:09.247299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:18:09.310813 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1bed0080-0e63-44ac-a0dc-e2d3bb17bd03 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:09.311603 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1bed0080-0e63-44ac-a0dc-e2d3bb17bd03 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:09.335584 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-14a07d84-2aa2-45b8-9724-bbbea615c7f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.756555 May 26 18:18:09.336287 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1bed0080-0e63-44ac-a0dc-e2d3bb17bd03 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:09.336888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1bed0080-0e63-44ac-a0dc-e2d3bb17bd03 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:09.338131 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1bed0080-0e63-44ac-a0dc-e2d3bb17bd03 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:09.339520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1bed0080-0e63-44ac-a0dc-e2d3bb17bd03 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:09.339950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 15/28] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:18:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:18:09.351869 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-835b8f98-c5e8-4222-a34e-920f82d8d0b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:09.353088 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-835b8f98-c5e8-4222-a34e-920f82d8d0b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:09.360812 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-835b8f98-c5e8-4222-a34e-920f82d8d0b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:09.363794 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-835b8f98-c5e8-4222-a34e-920f82d8d0b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:09.364756 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-835b8f98-c5e8-4222-a34e-920f82d8d0b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:09.365352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-835b8f98-c5e8-4222-a34e-920f82d8d0b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:09.664111 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-835b8f98-c5e8-4222-a34e-920f82d8d0b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:09.686510 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-835b8f98-c5e8-4222-a34e-920f82d8d0b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1299 microversion: 2.1 time: 0.344496 May 26 18:18:09.693055 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 16/29] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:09 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1299 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:09.746299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-86cd53d9-2ef3-424f-8848-233594df1780 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:09.747864 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-86cd53d9-2ef3-424f-8848-233594df1780 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:09.914001 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-86cd53d9-2ef3-424f-8848-233594df1780 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:09.924690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-86cd53d9-2ef3-424f-8848-233594df1780 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1238 microversion: 2.1 time: 0.215920 May 26 18:18:09.927382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 17/30] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:09 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1238 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:09.942205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8a38342e-4d22-4c98-a514-f7bab0636de3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:09.956578 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8a38342e-4d22-4c98-a514-f7bab0636de3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:09.991583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a38342e-4d22-4c98-a514-f7bab0636de3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:09.994386 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a38342e-4d22-4c98-a514-f7bab0636de3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:09.996465 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a38342e-4d22-4c98-a514-f7bab0636de3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:10.002174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a38342e-4d22-4c98-a514-f7bab0636de3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:10.270195 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1bed0080-0e63-44ac-a0dc-e2d3bb17bd03 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:10.281808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1bed0080-0e63-44ac-a0dc-e2d3bb17bd03 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.976091 May 26 18:18:10.283132 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 14/31] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:09 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:10.366081 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8a38342e-4d22-4c98-a514-f7bab0636de3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:10.401674 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8a38342e-4d22-4c98-a514-f7bab0636de3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1226 microversion: 2.1 time: 0.472832 May 26 18:18:10.422338 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 18/32] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:09 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1226 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:10.714905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5c6bd633-29bc-44c2-bab6-545eaaf817c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:10.715595 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-5c6bd633-29bc-44c2-bab6-545eaaf817c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:10.726316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5c6bd633-29bc-44c2-bab6-545eaaf817c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:10.726778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5c6bd633-29bc-44c2-bab6-545eaaf817c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:10.727569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5c6bd633-29bc-44c2-bab6-545eaaf817c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:10.728009 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5c6bd633-29bc-44c2-bab6-545eaaf817c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:10.861618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-5c6bd633-29bc-44c2-bab6-545eaaf817c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:10.872709 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5c6bd633-29bc-44c2-bab6-545eaaf817c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1299 microversion: 2.1 time: 0.159073 May 26 18:18:10.884965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 15/33] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:10 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:10.944822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cd358faa-428d-42af-961b-76fe4e052891 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:10.945443 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cd358faa-428d-42af-961b-76fe4e052891 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:10.951621 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cd358faa-428d-42af-961b-76fe4e052891 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:10.952310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cd358faa-428d-42af-961b-76fe4e052891 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:10.953299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cd358faa-428d-42af-961b-76fe4e052891 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:10.953951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cd358faa-428d-42af-961b-76fe4e052891 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:11.085075 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cd358faa-428d-42af-961b-76fe4e052891 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:11.097984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cd358faa-428d-42af-961b-76fe4e052891 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1234 microversion: 2.1 time: 0.156659 May 26 18:18:11.098879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 19/34] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:10 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1234 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:11.301353 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4b9ae296-7913-490c-8aca-ccb0281c6b1c tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:11.302099 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4b9ae296-7913-490c-8aca-ccb0281c6b1c tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:11.311022 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4b9ae296-7913-490c-8aca-ccb0281c6b1c tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:11.312656 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4b9ae296-7913-490c-8aca-ccb0281c6b1c tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:11.313685 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4b9ae296-7913-490c-8aca-ccb0281c6b1c tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:11.323803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4b9ae296-7913-490c-8aca-ccb0281c6b1c tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:11.442115 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-40d0f271-8683-49bb-bbba-b34cc451a22f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:11.442790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-40d0f271-8683-49bb-bbba-b34cc451a22f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:11.454195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-40d0f271-8683-49bb-bbba-b34cc451a22f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:11.454822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-40d0f271-8683-49bb-bbba-b34cc451a22f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:11.456513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-40d0f271-8683-49bb-bbba-b34cc451a22f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:11.456949 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-40d0f271-8683-49bb-bbba-b34cc451a22f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:11.646238 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-40d0f271-8683-49bb-bbba-b34cc451a22f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:11.659368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-40d0f271-8683-49bb-bbba-b34cc451a22f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1274 microversion: 2.1 time: 0.223498 May 26 18:18:11.661604 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 20/35] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:11 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1274 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:11.703185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4b9ae296-7913-490c-8aca-ccb0281c6b1c tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:11.713222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4b9ae296-7913-490c-8aca-ccb0281c6b1c tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.417711 May 26 18:18:11.714147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 16/36] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:11 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:11.894746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c6b47b81-e857-4d99-9b4b-d803c2be8ece tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:11.895695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c6b47b81-e857-4d99-9b4b-d803c2be8ece tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:11.934310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c6b47b81-e857-4d99-9b4b-d803c2be8ece tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:11.934774 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c6b47b81-e857-4d99-9b4b-d803c2be8ece tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:11.937026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c6b47b81-e857-4d99-9b4b-d803c2be8ece tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:11.937529 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c6b47b81-e857-4d99-9b4b-d803c2be8ece tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:12.106304 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c6b47b81-e857-4d99-9b4b-d803c2be8ece tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:12.114671 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c6b47b81-e857-4d99-9b4b-d803c2be8ece tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.226221 May 26 18:18:12.115249 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 21/37] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:11 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:12.116606 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ae87992f-0c8a-4f45-8ebf-ec847a179c4e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:12.117344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ae87992f-0c8a-4f45-8ebf-ec847a179c4e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:12.123808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ae87992f-0c8a-4f45-8ebf-ec847a179c4e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:12.124447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ae87992f-0c8a-4f45-8ebf-ec847a179c4e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:12.125220 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ae87992f-0c8a-4f45-8ebf-ec847a179c4e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:12.125656 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ae87992f-0c8a-4f45-8ebf-ec847a179c4e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:12.194404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ae87992f-0c8a-4f45-8ebf-ec847a179c4e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:12.202701 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ae87992f-0c8a-4f45-8ebf-ec847a179c4e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1234 microversion: 2.1 time: 0.090091 May 26 18:18:12.203486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 17/38] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:12 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:12.678135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b204938a-d4eb-40d1-bb10-51abc25ee1bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:12.678754 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b204938a-d4eb-40d1-bb10-51abc25ee1bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:12.684776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b204938a-d4eb-40d1-bb10-51abc25ee1bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:12.685244 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b204938a-d4eb-40d1-bb10-51abc25ee1bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:12.686050 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b204938a-d4eb-40d1-bb10-51abc25ee1bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:12.686492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b204938a-d4eb-40d1-bb10-51abc25ee1bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:12.733203 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a4270fd7-31ca-4aab-892f-9f1c8ec8b86e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:12.733858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a4270fd7-31ca-4aab-892f-9f1c8ec8b86e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:12.740406 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4270fd7-31ca-4aab-892f-9f1c8ec8b86e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:12.740918 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4270fd7-31ca-4aab-892f-9f1c8ec8b86e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:12.741697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4270fd7-31ca-4aab-892f-9f1c8ec8b86e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:12.742169 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4270fd7-31ca-4aab-892f-9f1c8ec8b86e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:12.751276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b204938a-d4eb-40d1-bb10-51abc25ee1bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:12.761133 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b204938a-d4eb-40d1-bb10-51abc25ee1bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1274 microversion: 2.1 time: 0.086826 May 26 18:18:12.761704 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 22/39] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:12 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:12.874513 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a4270fd7-31ca-4aab-892f-9f1c8ec8b86e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:12.882344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a4270fd7-31ca-4aab-892f-9f1c8ec8b86e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.152943 May 26 18:18:12.882858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 18/40] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:12 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:13.132539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fd84125d-b9cc-45e7-bce0-10b830b98e40 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:13.133361 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fd84125d-b9cc-45e7-bce0-10b830b98e40 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:13.139338 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd84125d-b9cc-45e7-bce0-10b830b98e40 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:13.139817 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd84125d-b9cc-45e7-bce0-10b830b98e40 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:13.140559 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd84125d-b9cc-45e7-bce0-10b830b98e40 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:13.140997 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd84125d-b9cc-45e7-bce0-10b830b98e40 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:13.146322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:13.220907 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-afc8a38c-81f9-44e6-9079-ba494d67ed79 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:13.221526 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-afc8a38c-81f9-44e6-9079-ba494d67ed79 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:13.227842 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-afc8a38c-81f9-44e6-9079-ba494d67ed79 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:13.228366 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-afc8a38c-81f9-44e6-9079-ba494d67ed79 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:13.233879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-afc8a38c-81f9-44e6-9079-ba494d67ed79 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:13.234740 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-afc8a38c-81f9-44e6-9079-ba494d67ed79 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:13.418500 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-afc8a38c-81f9-44e6-9079-ba494d67ed79 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:13.427696 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-afc8a38c-81f9-44e6-9079-ba494d67ed79 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1234 microversion: 2.1 time: 0.211171 May 26 18:18:13.428829 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 19/41] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:13 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1234 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:13.453955 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fd84125d-b9cc-45e7-bce0-10b830b98e40 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:13.462012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fd84125d-b9cc-45e7-bce0-10b830b98e40 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.333475 May 26 18:18:13.462583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 23/42] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:13 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:13.778984 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f0575b40-77c1-44fb-98ba-3c50ac6bed4a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:13.779909 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f0575b40-77c1-44fb-98ba-3c50ac6bed4a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:13.788262 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f0575b40-77c1-44fb-98ba-3c50ac6bed4a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:13.789003 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f0575b40-77c1-44fb-98ba-3c50ac6bed4a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:13.790410 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f0575b40-77c1-44fb-98ba-3c50ac6bed4a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:13.791170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f0575b40-77c1-44fb-98ba-3c50ac6bed4a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:13.899235 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6b7c0826-1584-41d5-b545-642e1ff964be tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:13.900418 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6b7c0826-1584-41d5-b545-642e1ff964be tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:13.911466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f0575b40-77c1-44fb-98ba-3c50ac6bed4a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:13.911797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6b7c0826-1584-41d5-b545-642e1ff964be tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:13.912546 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6b7c0826-1584-41d5-b545-642e1ff964be tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:13.915017 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6b7c0826-1584-41d5-b545-642e1ff964be tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:13.916566 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6b7c0826-1584-41d5-b545-642e1ff964be tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:13.930424 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f0575b40-77c1-44fb-98ba-3c50ac6bed4a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1274 microversion: 2.1 time: 0.155367 May 26 18:18:13.931285 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 20/43] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:13 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:14.186282 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6b7c0826-1584-41d5-b545-642e1ff964be tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:14.197379 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6b7c0826-1584-41d5-b545-642e1ff964be tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.301866 May 26 18:18:14.201262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 24/44] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:13 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:14.445247 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-12820dff-2731-4204-9fc6-37eceed09cc9 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:14.445997 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-12820dff-2731-4204-9fc6-37eceed09cc9 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:14.464533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-12820dff-2731-4204-9fc6-37eceed09cc9 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:14.465296 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-12820dff-2731-4204-9fc6-37eceed09cc9 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:14.468431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-12820dff-2731-4204-9fc6-37eceed09cc9 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:14.469188 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-12820dff-2731-4204-9fc6-37eceed09cc9 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:14.480531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fb799fc6-74ec-4781-898a-102aba1b2dd6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:14.481685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fb799fc6-74ec-4781-898a-102aba1b2dd6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:14.495090 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb799fc6-74ec-4781-898a-102aba1b2dd6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:14.496784 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb799fc6-74ec-4781-898a-102aba1b2dd6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:14.498698 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb799fc6-74ec-4781-898a-102aba1b2dd6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:14.506284 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb799fc6-74ec-4781-898a-102aba1b2dd6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:14.742893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-12820dff-2731-4204-9fc6-37eceed09cc9 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:14.760921 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-12820dff-2731-4204-9fc6-37eceed09cc9 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1290 microversion: 2.1 time: 0.319611 May 26 18:18:14.774318 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 21/45] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:14 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1290 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:14.802929 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-a6d5e0b7-dce3-4db1-9030-36a51b0441fd req-2c6aae62-604b-4d56-83f0-a77bb123d391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158ce769-fde9-413e-81f3-d76b3222b5fc", "tag": "d8a8f1c3-9b31-4ff3-a2a8-371608a6812a"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:14.907084 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a6d5e0b7-dce3-4db1-9030-36a51b0441fd req-2c6aae62-604b-4d56-83f0-a77bb123d391 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:14.907532 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a6d5e0b7-dce3-4db1-9030-36a51b0441fd req-2c6aae62-604b-4d56-83f0-a77bb123d391 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:14.979301 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fb799fc6-74ec-4781-898a-102aba1b2dd6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:14.989252 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fb799fc6-74ec-4781-898a-102aba1b2dd6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.512950 May 26 18:18:14.990762 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 25/46] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:14 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:14.991496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-a6d5e0b7-dce3-4db1-9030-36a51b0441fd req-2c6aae62-604b-4d56-83f0-a77bb123d391 service nova] Creating event network-changed:d8a8f1c3-9b31-4ff3-a2a8-371608a6812a for instance 158ce769-fde9-413e-81f3-d76b3222b5fc on hv-cinder-84349 May 26 18:18:14.992048 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a6d5e0b7-dce3-4db1-9030-36a51b0441fd req-2c6aae62-604b-4d56-83f0-a77bb123d391 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 18:18:14.993185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97d242d3-769b-4d28-ab9c-578b7108074c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:14.993691 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97d242d3-769b-4d28-ab9c-578b7108074c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:14.995180 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97d242d3-769b-4d28-ab9c-578b7108074c None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:14.995788 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97d242d3-769b-4d28-ab9c-578b7108074c None None] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:15.029313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.compute.rpcapi [None req-97d242d3-769b-4d28-ab9c-578b7108074c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 18:18:15.030565 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97d242d3-769b-4d28-ab9c-578b7108074c None None] Releasing lock "compute-rpcapi-router" {{(pid=117697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 18:18:15.031527 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0a76835c-5d54-4499-8397-b78e64f950f4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:15.039530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0a76835c-5d54-4499-8397-b78e64f950f4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:15.067602 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0a76835c-5d54-4499-8397-b78e64f950f4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:15.068061 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0a76835c-5d54-4499-8397-b78e64f950f4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:15.074087 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0a76835c-5d54-4499-8397-b78e64f950f4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:15.074583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0a76835c-5d54-4499-8397-b78e64f950f4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:15.084731 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-97d242d3-769b-4d28-ab9c-578b7108074c None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305452 May 26 18:18:15.085391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 22/47] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:15.218480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-48df74d6-0bd1-4beb-9caf-04e6eb98bacb tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:15.219625 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-48df74d6-0bd1-4beb-9caf-04e6eb98bacb tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:15.230976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-48df74d6-0bd1-4beb-9caf-04e6eb98bacb tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:15.237761 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-48df74d6-0bd1-4beb-9caf-04e6eb98bacb tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:15.238832 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-48df74d6-0bd1-4beb-9caf-04e6eb98bacb tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:15.242884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-48df74d6-0bd1-4beb-9caf-04e6eb98bacb tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:15.446706 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0a76835c-5d54-4499-8397-b78e64f950f4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:15.459115 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0a76835c-5d54-4499-8397-b78e64f950f4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1282 microversion: 2.1 time: 0.467128 May 26 18:18:15.460217 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 26/48] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:14 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1282 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:15.656784 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-55469c65-58ac-4818-bfc0-fb92cc2d7c31 req-3d2b957f-cb9b-4e79-a782-7e6f8a3d25e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56b5f3b-8d96-4c3a-92d3-8abd6feea703", "tag": "afd70552-5afd-45e8-8ac9-e7f6449dc43e"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:15.663684 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:15.682070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-55469c65-58ac-4818-bfc0-fb92cc2d7c31 req-3d2b957f-cb9b-4e79-a782-7e6f8a3d25e1 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:15.682517 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-55469c65-58ac-4818-bfc0-fb92cc2d7c31 req-3d2b957f-cb9b-4e79-a782-7e6f8a3d25e1 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:15.719359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-55469c65-58ac-4818-bfc0-fb92cc2d7c31 req-3d2b957f-cb9b-4e79-a782-7e6f8a3d25e1 service nova] Creating event network-changed:afd70552-5afd-45e8-8ac9-e7f6449dc43e for instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 on hv-cinder-84349 May 26 18:18:15.732477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-55469c65-58ac-4818-bfc0-fb92cc2d7c31 req-3d2b957f-cb9b-4e79-a782-7e6f8a3d25e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269497 May 26 18:18:15.733577 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 27/49] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:15.782278 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6616c833-9f5d-49de-9f1e-6a00524b04fe tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:15.783550 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6616c833-9f5d-49de-9f1e-6a00524b04fe tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:15.800014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6616c833-9f5d-49de-9f1e-6a00524b04fe tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:15.800676 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6616c833-9f5d-49de-9f1e-6a00524b04fe tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:15.801506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6616c833-9f5d-49de-9f1e-6a00524b04fe tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:15.802002 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6616c833-9f5d-49de-9f1e-6a00524b04fe tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:15.970844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-48df74d6-0bd1-4beb-9caf-04e6eb98bacb tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:15.981846 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-48df74d6-0bd1-4beb-9caf-04e6eb98bacb tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.766102 May 26 18:18:15.984738 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 23/50] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:15 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:16.020489 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4f8ecdbf-b656-4e6d-9869-c16bf15e7796 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:16.021212 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4f8ecdbf-b656-4e6d-9869-c16bf15e7796 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:16.038703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f8ecdbf-b656-4e6d-9869-c16bf15e7796 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.039191 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f8ecdbf-b656-4e6d-9869-c16bf15e7796 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.041253 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f8ecdbf-b656-4e6d-9869-c16bf15e7796 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.041690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f8ecdbf-b656-4e6d-9869-c16bf15e7796 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.316706 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6616c833-9f5d-49de-9f1e-6a00524b04fe tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:16.326759 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6616c833-9f5d-49de-9f1e-6a00524b04fe tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1298 microversion: 2.1 time: 0.550399 May 26 18:18:16.328129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 28/51] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:15 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1298 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:16.478750 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4d6e0b86-dee3-4f07-a39a-012901e93f64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:16.480892 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4d6e0b86-dee3-4f07-a39a-012901e93f64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:16.495382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d6e0b86-dee3-4f07-a39a-012901e93f64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.496424 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d6e0b86-dee3-4f07-a39a-012901e93f64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.500003 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d6e0b86-dee3-4f07-a39a-012901e93f64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.500667 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d6e0b86-dee3-4f07-a39a-012901e93f64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.725309 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4d6e0b86-dee3-4f07-a39a-012901e93f64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:16.737284 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4d6e0b86-dee3-4f07-a39a-012901e93f64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1280 microversion: 2.1 time: 0.263832 May 26 18:18:16.748146 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 29/52] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:16 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:16.769139 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4f8ecdbf-b656-4e6d-9869-c16bf15e7796 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:16.778818 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4f8ecdbf-b656-4e6d-9869-c16bf15e7796 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.763862 May 26 18:18:16.780311 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 24/53] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:16 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:17.002230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-df11a727-94a3-4609-a014-a42412b3b231 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:17.002981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-df11a727-94a3-4609-a014-a42412b3b231 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:17.010224 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df11a727-94a3-4609-a014-a42412b3b231 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:17.011027 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df11a727-94a3-4609-a014-a42412b3b231 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:17.011929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df11a727-94a3-4609-a014-a42412b3b231 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:17.012505 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df11a727-94a3-4609-a014-a42412b3b231 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:17.238267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-df11a727-94a3-4609-a014-a42412b3b231 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:17.250396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-df11a727-94a3-4609-a014-a42412b3b231 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.253430 May 26 18:18:17.251437 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 30/54] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:16 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:17.346920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-af8e00f6-6865-4c31-a363-08d2a8137e16 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:17.346920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-af8e00f6-6865-4c31-a363-08d2a8137e16 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:17.348987 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=26 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:17.376348 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af8e00f6-6865-4c31-a363-08d2a8137e16 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:17.376827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af8e00f6-6865-4c31-a363-08d2a8137e16 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:17.377610 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af8e00f6-6865-4c31-a363-08d2a8137e16 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:17.383085 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af8e00f6-6865-4c31-a363-08d2a8137e16 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:17.756941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-190e02fd-4ca6-4cee-9be1-fc5c6a0772ee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:17.759186 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-190e02fd-4ca6-4cee-9be1-fc5c6a0772ee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:17.767646 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-190e02fd-4ca6-4cee-9be1-fc5c6a0772ee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:17.768981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-190e02fd-4ca6-4cee-9be1-fc5c6a0772ee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:17.770014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-190e02fd-4ca6-4cee-9be1-fc5c6a0772ee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:17.770751 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-190e02fd-4ca6-4cee-9be1-fc5c6a0772ee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:17.912364 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-af8e00f6-6865-4c31-a363-08d2a8137e16 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:17.926316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-af8e00f6-6865-4c31-a363-08d2a8137e16 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1296 microversion: 2.1 time: 0.585598 May 26 18:18:17.931342 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 25/55] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:17 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1296 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:17.946296 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-79b3e5ca-1e67-47c1-a098-51220be1361b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:17.950901 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-79b3e5ca-1e67-47c1-a098-51220be1361b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:17.976472 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-79b3e5ca-1e67-47c1-a098-51220be1361b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:17.976937 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-79b3e5ca-1e67-47c1-a098-51220be1361b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:17.981787 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-79b3e5ca-1e67-47c1-a098-51220be1361b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:17.982322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-79b3e5ca-1e67-47c1-a098-51220be1361b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:18.024896 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-190e02fd-4ca6-4cee-9be1-fc5c6a0772ee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:18.037693 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-190e02fd-4ca6-4cee-9be1-fc5c6a0772ee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.287022 May 26 18:18:18.040469 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 31/56] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:17 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:18.185423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-79b3e5ca-1e67-47c1-a098-51220be1361b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:18.194995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-79b3e5ca-1e67-47c1-a098-51220be1361b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.262249 May 26 18:18:18.197185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 26/57] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:17 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:18.270530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-95c8322d-fa5b-42be-8db1-f1bb2bc05783 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:18.271446 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-95c8322d-fa5b-42be-8db1-f1bb2bc05783 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:18.278288 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-95c8322d-fa5b-42be-8db1-f1bb2bc05783 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:18.278972 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-95c8322d-fa5b-42be-8db1-f1bb2bc05783 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:18.279953 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-95c8322d-fa5b-42be-8db1-f1bb2bc05783 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:18.280744 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-95c8322d-fa5b-42be-8db1-f1bb2bc05783 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:18.950366 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c95c64b5-c8a7-4a42-9f38-1b735b40662e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:18.951883 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c95c64b5-c8a7-4a42-9f38-1b735b40662e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:18.962120 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-95c8322d-fa5b-42be-8db1-f1bb2bc05783 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:18.966405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c95c64b5-c8a7-4a42-9f38-1b735b40662e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:18.967669 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c95c64b5-c8a7-4a42-9f38-1b735b40662e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:18.971259 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c95c64b5-c8a7-4a42-9f38-1b735b40662e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:18.971987 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c95c64b5-c8a7-4a42-9f38-1b735b40662e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:18.972941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-95c8322d-fa5b-42be-8db1-f1bb2bc05783 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.708305 May 26 18:18:18.973702 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 32/58] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:18 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:19.064931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9b5c73e8-0285-4920-adec-ab71f9c38ee3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:19.065542 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9b5c73e8-0285-4920-adec-ab71f9c38ee3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:19.079272 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9b5c73e8-0285-4920-adec-ab71f9c38ee3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:19.082629 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9b5c73e8-0285-4920-adec-ab71f9c38ee3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:19.083427 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9b5c73e8-0285-4920-adec-ab71f9c38ee3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:19.083883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9b5c73e8-0285-4920-adec-ab71f9c38ee3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:19.109618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c95c64b5-c8a7-4a42-9f38-1b735b40662e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:19.119247 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c95c64b5-c8a7-4a42-9f38-1b735b40662e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1296 microversion: 2.1 time: 0.174640 May 26 18:18:19.120411 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 27/59] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:18 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1296 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:19.215959 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e189b207-2f01-4ca8-bab2-e48047a2af4f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:19.217000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e189b207-2f01-4ca8-bab2-e48047a2af4f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:19.217752 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:19.226955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e189b207-2f01-4ca8-bab2-e48047a2af4f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:19.228301 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e189b207-2f01-4ca8-bab2-e48047a2af4f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:19.229556 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e189b207-2f01-4ca8-bab2-e48047a2af4f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:19.230278 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e189b207-2f01-4ca8-bab2-e48047a2af4f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:19.868306 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9b5c73e8-0285-4920-adec-ab71f9c38ee3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:19.883119 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9b5c73e8-0285-4920-adec-ab71f9c38ee3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.828090 May 26 18:18:19.883932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 33/60] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:19 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:19.991619 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f17c4c14-5bdd-4be2-a5a5-321569ba342f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:19.991619 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f17c4c14-5bdd-4be2-a5a5-321569ba342f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:19.993391 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=20 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:20.009158 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f17c4c14-5bdd-4be2-a5a5-321569ba342f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.009623 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f17c4c14-5bdd-4be2-a5a5-321569ba342f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.013695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f17c4c14-5bdd-4be2-a5a5-321569ba342f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.014531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f17c4c14-5bdd-4be2-a5a5-321569ba342f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.085581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e189b207-2f01-4ca8-bab2-e48047a2af4f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:20.101264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e189b207-2f01-4ca8-bab2-e48047a2af4f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.889149 May 26 18:18:20.102842 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 28/61] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:19 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:20.137200 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1117f963-3b50-43e3-9aeb-4bf9e84878da tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:20.137979 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1117f963-3b50-43e3-9aeb-4bf9e84878da tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:20.152700 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1117f963-3b50-43e3-9aeb-4bf9e84878da tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.155172 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1117f963-3b50-43e3-9aeb-4bf9e84878da tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.156300 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1117f963-3b50-43e3-9aeb-4bf9e84878da tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.158952 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1117f963-3b50-43e3-9aeb-4bf9e84878da tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.170186 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=100 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:20.404440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1117f963-3b50-43e3-9aeb-4bf9e84878da tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:20.428304 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1117f963-3b50-43e3-9aeb-4bf9e84878da tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1296 microversion: 2.1 time: 0.294347 May 26 18:18:20.430283 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 29/62] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:20 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1296 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:20.862123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-25af7092-5179-45f8-a148-74cff44ea73d req-112c9870-dc82-4a27-927f-01d871579c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e", "name": "network-vif-plugged", "status": "completed", "tag": "2ec1e990-e50a-44d3-aeb8-f9a33c92c72b"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:20.873640 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f17c4c14-5bdd-4be2-a5a5-321569ba342f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:20.874010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-25af7092-5179-45f8-a148-74cff44ea73d req-112c9870-dc82-4a27-927f-01d871579c2c service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.874487 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-25af7092-5179-45f8-a148-74cff44ea73d req-112c9870-dc82-4a27-927f-01d871579c2c service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.885427 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f17c4c14-5bdd-4be2-a5a5-321569ba342f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.899327 May 26 18:18:20.886812 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 34/63] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:19 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:20.913186 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c94ba815-b898-48a1-a7cf-874affacb634 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:20.914545 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c94ba815-b898-48a1-a7cf-874affacb634 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:20.934055 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c94ba815-b898-48a1-a7cf-874affacb634 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.935324 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c94ba815-b898-48a1-a7cf-874affacb634 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.937059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-25af7092-5179-45f8-a148-74cff44ea73d req-112c9870-dc82-4a27-927f-01d871579c2c service nova] Creating event network-vif-plugged:2ec1e990-e50a-44d3-aeb8-f9a33c92c72b for instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e on hv-cinder-84349 May 26 18:18:20.937192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c94ba815-b898-48a1-a7cf-874affacb634 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.939269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c94ba815-b898-48a1-a7cf-874affacb634 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.986883 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-25af7092-5179-45f8-a148-74cff44ea73d req-112c9870-dc82-4a27-927f-01d871579c2c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.441830 May 26 18:18:20.992561 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 30/64] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:21.121875 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-afcf1d82-4409-4384-b750-73992899874a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:21.122589 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-afcf1d82-4409-4384-b750-73992899874a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:21.137671 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-afcf1d82-4409-4384-b750-73992899874a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:21.143802 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-afcf1d82-4409-4384-b750-73992899874a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:21.147677 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-afcf1d82-4409-4384-b750-73992899874a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:21.149163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-afcf1d82-4409-4384-b750-73992899874a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:21.848281 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c94ba815-b898-48a1-a7cf-874affacb634 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:21.866938 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c94ba815-b898-48a1-a7cf-874affacb634 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.967431 May 26 18:18:21.878484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 35/65] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:20 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:21.888964 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2d458d1f-6422-445e-8db8-b2bab3b82430 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:21.893479 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2d458d1f-6422-445e-8db8-b2bab3b82430 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:21.912441 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d458d1f-6422-445e-8db8-b2bab3b82430 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:21.913850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d458d1f-6422-445e-8db8-b2bab3b82430 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:21.914946 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d458d1f-6422-445e-8db8-b2bab3b82430 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:21.915661 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d458d1f-6422-445e-8db8-b2bab3b82430 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:21.960637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-afcf1d82-4409-4384-b750-73992899874a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:21.980411 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-afcf1d82-4409-4384-b750-73992899874a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.862663 May 26 18:18:21.986319 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 31/66] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:21 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:21.993107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d9e07671-f2f7-4f74-a349-2547a8cc2ba2 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:21.995761 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d9e07671-f2f7-4f74-a349-2547a8cc2ba2 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:22.010863 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d9e07671-f2f7-4f74-a349-2547a8cc2ba2 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:22.011357 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d9e07671-f2f7-4f74-a349-2547a8cc2ba2 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:22.012206 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d9e07671-f2f7-4f74-a349-2547a8cc2ba2 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:22.013093 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d9e07671-f2f7-4f74-a349-2547a8cc2ba2 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:22.558466 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2d458d1f-6422-445e-8db8-b2bab3b82430 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:22.574778 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2d458d1f-6422-445e-8db8-b2bab3b82430 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.691441 May 26 18:18:22.578412 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 36/67] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:21 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:22.591901 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d9e07671-f2f7-4f74-a349-2547a8cc2ba2 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:22.604601 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d9e07671-f2f7-4f74-a349-2547a8cc2ba2 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.616928 May 26 18:18:22.607591 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 32/68] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:21 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:22.633309 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-f35ead08-1db7-4cd3-8333-c6187854a187 req-0102c59d-0e40-4954-85cd-d3009d8930fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5318d4c9-f954-4123-b0ce-d2b418f37dd3", "tag": "e97a903b-46cf-40f9-9aed-884e6e491c98"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:22.654540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-f35ead08-1db7-4cd3-8333-c6187854a187 req-0102c59d-0e40-4954-85cd-d3009d8930fc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:22.655067 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-f35ead08-1db7-4cd3-8333-c6187854a187 req-0102c59d-0e40-4954-85cd-d3009d8930fc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:22.682927 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-f35ead08-1db7-4cd3-8333-c6187854a187 req-0102c59d-0e40-4954-85cd-d3009d8930fc service nova] Creating event network-changed:e97a903b-46cf-40f9-9aed-884e6e491c98 for instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 on hv-cinder-84349 May 26 18:18:22.695210 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-f35ead08-1db7-4cd3-8333-c6187854a187 req-0102c59d-0e40-4954-85cd-d3009d8930fc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069287 May 26 18:18:22.700508 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 37/69] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:22.892858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-478fb932-1e4a-47e1-9b1d-134485663262 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:22.893858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-478fb932-1e4a-47e1-9b1d-134485663262 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:22.910674 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-478fb932-1e4a-47e1-9b1d-134485663262 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:22.911620 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-478fb932-1e4a-47e1-9b1d-134485663262 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:22.913897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-478fb932-1e4a-47e1-9b1d-134485663262 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:22.914492 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-478fb932-1e4a-47e1-9b1d-134485663262 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:23.000804 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ebd423b-7530-486c-857b-29df5559609f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:23.003550 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ebd423b-7530-486c-857b-29df5559609f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:23.012546 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ebd423b-7530-486c-857b-29df5559609f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:23.012986 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ebd423b-7530-486c-857b-29df5559609f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:23.013960 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ebd423b-7530-486c-857b-29df5559609f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:23.014574 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ebd423b-7530-486c-857b-29df5559609f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:23.805334 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ebd423b-7530-486c-857b-29df5559609f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:23.813670 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ebd423b-7530-486c-857b-29df5559609f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.816766 May 26 18:18:23.824412 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 38/70] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:22 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:23.829187 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e8948f7c-5036-46a3-951e-cd91f58e286d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:23.830698 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e8948f7c-5036-46a3-951e-cd91f58e286d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:23.837074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8948f7c-5036-46a3-951e-cd91f58e286d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:23.837918 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8948f7c-5036-46a3-951e-cd91f58e286d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:23.839103 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8948f7c-5036-46a3-951e-cd91f58e286d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:23.839544 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8948f7c-5036-46a3-951e-cd91f58e286d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:23.939522 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-478fb932-1e4a-47e1-9b1d-134485663262 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:23.949543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-478fb932-1e4a-47e1-9b1d-134485663262 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 1.068392 May 26 18:18:23.961385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 33/71] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:22 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:23.969023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4787ed3f-6726-4b19-a403-aec46e7559b9 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:23.970761 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4787ed3f-6726-4b19-a403-aec46e7559b9 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:23.987885 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4787ed3f-6726-4b19-a403-aec46e7559b9 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:23.988995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4787ed3f-6726-4b19-a403-aec46e7559b9 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:23.990463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4787ed3f-6726-4b19-a403-aec46e7559b9 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:23.991118 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4787ed3f-6726-4b19-a403-aec46e7559b9 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.519679 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e8948f7c-5036-46a3-951e-cd91f58e286d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:24.530297 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e8948f7c-5036-46a3-951e-cd91f58e286d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.704673 May 26 18:18:24.532437 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 39/72] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:23 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:24.536966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-913b09bf-b503-44d1-b4ed-e31be443fc42 req-63db10e3-b0cb-46e5-83b6-a87cd9dfae52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56b5f3b-8d96-4c3a-92d3-8abd6feea703", "name": "network-vif-plugged", "status": "completed", "tag": "afd70552-5afd-45e8-8ac9-e7f6449dc43e"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:24.559219 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-913b09bf-b503-44d1-b4ed-e31be443fc42 req-63db10e3-b0cb-46e5-83b6-a87cd9dfae52 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.564310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-913b09bf-b503-44d1-b4ed-e31be443fc42 req-63db10e3-b0cb-46e5-83b6-a87cd9dfae52 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.580315 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-913b09bf-b503-44d1-b4ed-e31be443fc42 req-63db10e3-b0cb-46e5-83b6-a87cd9dfae52 service nova] Creating event network-vif-plugged:afd70552-5afd-45e8-8ac9-e7f6449dc43e for instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 on hv-cinder-84349 May 26 18:18:24.587814 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-913b09bf-b503-44d1-b4ed-e31be443fc42 req-63db10e3-b0cb-46e5-83b6-a87cd9dfae52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053636 May 26 18:18:24.588067 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 40/73] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:24.596094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4787ed3f-6726-4b19-a403-aec46e7559b9 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:24.613014 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4787ed3f-6726-4b19-a403-aec46e7559b9 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1313 microversion: 2.1 time: 0.648993 May 26 18:18:24.613627 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 34/74] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:23 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:24.831716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-26bde987-83dd-460d-be64-6394ba9604f5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:24.832479 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-26bde987-83dd-460d-be64-6394ba9604f5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:24.842979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-26bde987-83dd-460d-be64-6394ba9604f5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.843990 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-26bde987-83dd-460d-be64-6394ba9604f5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.844232 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-26bde987-83dd-460d-be64-6394ba9604f5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.844697 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-26bde987-83dd-460d-be64-6394ba9604f5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.970872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2b206f4c-8dcc-41d1-8dbd-429ad5eb41a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:24.971551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2b206f4c-8dcc-41d1-8dbd-429ad5eb41a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:24.981226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b206f4c-8dcc-41d1-8dbd-429ad5eb41a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.981685 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b206f4c-8dcc-41d1-8dbd-429ad5eb41a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.988037 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b206f4c-8dcc-41d1-8dbd-429ad5eb41a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.993476 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b206f4c-8dcc-41d1-8dbd-429ad5eb41a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.033138 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=6 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:25.488356 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-26bde987-83dd-460d-be64-6394ba9604f5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:25.492462 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:25.497184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-26bde987-83dd-460d-be64-6394ba9604f5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.670079 May 26 18:18:25.509624 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 41/75] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:24 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:25.525421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-90a42b4f-2a67-45d7-acac-5aaefb7e0092 req-a5b0df2f-38c3-4ffd-82ea-a0034882b502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1715d8f6-ce4b-48d3-96b0-0717bc0ac54a", "tag": "5791c3dc-854e-4168-8bdd-187fa96c5f33"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:25.582329 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-90a42b4f-2a67-45d7-acac-5aaefb7e0092 req-a5b0df2f-38c3-4ffd-82ea-a0034882b502 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.584094 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-90a42b4f-2a67-45d7-acac-5aaefb7e0092 req-a5b0df2f-38c3-4ffd-82ea-a0034882b502 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.607153 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-90a42b4f-2a67-45d7-acac-5aaefb7e0092 req-a5b0df2f-38c3-4ffd-82ea-a0034882b502 service nova] Creating event network-changed:5791c3dc-854e-4168-8bdd-187fa96c5f33 for instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a on hv-cinder-84349 May 26 18:18:25.616987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-90a42b4f-2a67-45d7-acac-5aaefb7e0092 req-a5b0df2f-38c3-4ffd-82ea-a0034882b502 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094482 May 26 18:18:25.618023 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 42/76] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:25.626107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-85f5c351-2eab-4760-af57-4c16879c7d68 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:25.628275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-85f5c351-2eab-4760-af57-4c16879c7d68 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:25.636990 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85f5c351-2eab-4760-af57-4c16879c7d68 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.637749 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85f5c351-2eab-4760-af57-4c16879c7d68 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.639437 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85f5c351-2eab-4760-af57-4c16879c7d68 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.640139 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85f5c351-2eab-4760-af57-4c16879c7d68 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.961498 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2b206f4c-8dcc-41d1-8dbd-429ad5eb41a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:25.975960 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2b206f4c-8dcc-41d1-8dbd-429ad5eb41a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 1.010510 May 26 18:18:25.978054 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 35/77] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:24 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:25.984273 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-95fd1898-979d-44c4-a8bd-27f4eb82c631 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:25.985267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-95fd1898-979d-44c4-a8bd-27f4eb82c631 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:25.996497 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-95fd1898-979d-44c4-a8bd-27f4eb82c631 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.997368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-95fd1898-979d-44c4-a8bd-27f4eb82c631 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.998651 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-95fd1898-979d-44c4-a8bd-27f4eb82c631 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.999229 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-95fd1898-979d-44c4-a8bd-27f4eb82c631 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:26.210865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-85f5c351-2eab-4760-af57-4c16879c7d68 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:26.218502 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-85f5c351-2eab-4760-af57-4c16879c7d68 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.598247 May 26 18:18:26.219071 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 43/78] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:25 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:26.257866 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-95fd1898-979d-44c4-a8bd-27f4eb82c631 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:26.268888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-95fd1898-979d-44c4-a8bd-27f4eb82c631 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1499 microversion: 2.1 time: 0.289526 May 26 18:18:26.281226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 36/79] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:25 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1499 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:26.529530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-79c19b62-6780-4772-bb08-d819852e4828 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:26.530404 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-79c19b62-6780-4772-bb08-d819852e4828 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:26.544396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-79c19b62-6780-4772-bb08-d819852e4828 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:26.545124 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-79c19b62-6780-4772-bb08-d819852e4828 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:26.547342 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-79c19b62-6780-4772-bb08-d819852e4828 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:26.550471 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-79c19b62-6780-4772-bb08-d819852e4828 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:26.604331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-97f71579-0ced-4cca-85f9-5ff6a43b02bf req-18d2b2f6-6f62-441a-851c-742dc682e83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158ce769-fde9-413e-81f3-d76b3222b5fc", "name": "network-vif-plugged", "status": "completed", "tag": "d8a8f1c3-9b31-4ff3-a2a8-371608a6812a"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:26.625351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-97f71579-0ced-4cca-85f9-5ff6a43b02bf req-18d2b2f6-6f62-441a-851c-742dc682e83e service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:26.628523 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-97f71579-0ced-4cca-85f9-5ff6a43b02bf req-18d2b2f6-6f62-441a-851c-742dc682e83e service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:26.661011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-97f71579-0ced-4cca-85f9-5ff6a43b02bf req-18d2b2f6-6f62-441a-851c-742dc682e83e service nova] Creating event network-vif-plugged:d8a8f1c3-9b31-4ff3-a2a8-371608a6812a for instance 158ce769-fde9-413e-81f3-d76b3222b5fc on hv-cinder-84349 May 26 18:18:26.678295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-97f71579-0ced-4cca-85f9-5ff6a43b02bf req-18d2b2f6-6f62-441a-851c-742dc682e83e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078644 May 26 18:18:26.680456 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 37/80] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:26.996264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c8ef279f-3b90-48b0-821d-9010a97dfb4f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:26.998706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c8ef279f-3b90-48b0-821d-9010a97dfb4f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:27.034383 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c8ef279f-3b90-48b0-821d-9010a97dfb4f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:27.037848 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c8ef279f-3b90-48b0-821d-9010a97dfb4f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:27.043112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c8ef279f-3b90-48b0-821d-9010a97dfb4f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:27.043845 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c8ef279f-3b90-48b0-821d-9010a97dfb4f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:27.215773 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-79c19b62-6780-4772-bb08-d819852e4828 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:27.225519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-79c19b62-6780-4772-bb08-d819852e4828 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.702186 May 26 18:18:27.237802 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 44/81] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:26 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:27.242267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d3b59187-33df-466a-9984-50b24faf7cb5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:27.245430 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d3b59187-33df-466a-9984-50b24faf7cb5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:27.260188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d3b59187-33df-466a-9984-50b24faf7cb5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:27.263253 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d3b59187-33df-466a-9984-50b24faf7cb5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:27.264351 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d3b59187-33df-466a-9984-50b24faf7cb5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:27.264816 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d3b59187-33df-466a-9984-50b24faf7cb5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:27.504517 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c8ef279f-3b90-48b0-821d-9010a97dfb4f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:27.512228 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c8ef279f-3b90-48b0-821d-9010a97dfb4f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.520521 May 26 18:18:27.512820 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 38/82] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:26 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:27.530826 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d3b59187-33df-466a-9984-50b24faf7cb5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:27.540128 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d3b59187-33df-466a-9984-50b24faf7cb5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.302713 May 26 18:18:27.541195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 45/83] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:27 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:28.161070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-54c595bb-b7fa-4f59-bdc0-d863ecf23165 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86feeb63-e93d-45f2-9f18-710ff538db8d"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:28.162340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-54c595bb-b7fa-4f59-bdc0-d863ecf23165 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:28.171806 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54c595bb-b7fa-4f59-bdc0-d863ecf23165 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.174102 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54c595bb-b7fa-4f59-bdc0-d863ecf23165 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.174906 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54c595bb-b7fa-4f59-bdc0-d863ecf23165 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.177143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54c595bb-b7fa-4f59-bdc0-d863ecf23165 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.245686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8c97e9a1-8c89-44ea-982c-1107c255ff21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:28.246875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8c97e9a1-8c89-44ea-982c-1107c255ff21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:28.259256 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c97e9a1-8c89-44ea-982c-1107c255ff21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.260077 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c97e9a1-8c89-44ea-982c-1107c255ff21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.261210 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c97e9a1-8c89-44ea-982c-1107c255ff21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.262006 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c97e9a1-8c89-44ea-982c-1107c255ff21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.455580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8c97e9a1-8c89-44ea-982c-1107c255ff21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:28.468169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8c97e9a1-8c89-44ea-982c-1107c255ff21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.227551 May 26 18:18:28.469190 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 46/84] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:28 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:28.534406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5634f51a-cbb3-4a49-a992-2bd0f46ad946 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:28.535036 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5634f51a-cbb3-4a49-a992-2bd0f46ad946 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:28.543305 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5634f51a-cbb3-4a49-a992-2bd0f46ad946 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.543690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5634f51a-cbb3-4a49-a992-2bd0f46ad946 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.544456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5634f51a-cbb3-4a49-a992-2bd0f46ad946 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.544887 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5634f51a-cbb3-4a49-a992-2bd0f46ad946 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.748334 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5634f51a-cbb3-4a49-a992-2bd0f46ad946 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:28.758912 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5634f51a-cbb3-4a49-a992-2bd0f46ad946 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.229990 May 26 18:18:28.759809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 47/85] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:28 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:28.772688 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1e396bfd-3e8c-4f55-aead-da702063bfee tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:28.773603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1e396bfd-3e8c-4f55-aead-da702063bfee tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:28.780911 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1e396bfd-3e8c-4f55-aead-da702063bfee tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.781622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1e396bfd-3e8c-4f55-aead-da702063bfee tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.782828 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1e396bfd-3e8c-4f55-aead-da702063bfee tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.783450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1e396bfd-3e8c-4f55-aead-da702063bfee tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.926337 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1e396bfd-3e8c-4f55-aead-da702063bfee tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:28.933721 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1e396bfd-3e8c-4f55-aead-da702063bfee tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.172730 May 26 18:18:28.934579 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 48/86] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:28 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:29.490640 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0228c66c-e8d2-4540-8b33-a990dfbba86d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:29.491544 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0228c66c-e8d2-4540-8b33-a990dfbba86d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:29.505820 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0228c66c-e8d2-4540-8b33-a990dfbba86d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.518668 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0228c66c-e8d2-4540-8b33-a990dfbba86d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.519772 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0228c66c-e8d2-4540-8b33-a990dfbba86d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.520218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0228c66c-e8d2-4540-8b33-a990dfbba86d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.653864 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-54c595bb-b7fa-4f59-bdc0-d863ecf23165 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "POST /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.497681 May 26 18:18:29.655477 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 39/87] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:18:28 2022] POST /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e/os-volume_attachments => generated 194 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:29.780339 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-fc5828ef-08ae-4d58-8e30-bafd00088d6b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:29.781060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-fc5828ef-08ae-4d58-8e30-bafd00088d6b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:29.797898 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fc5828ef-08ae-4d58-8e30-bafd00088d6b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.800706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fc5828ef-08ae-4d58-8e30-bafd00088d6b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.804495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fc5828ef-08ae-4d58-8e30-bafd00088d6b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.805813 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fc5828ef-08ae-4d58-8e30-bafd00088d6b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.809611 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0228c66c-e8d2-4540-8b33-a990dfbba86d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:29.820363 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0228c66c-e8d2-4540-8b33-a990dfbba86d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1367 microversion: 2.1 time: 0.336266 May 26 18:18:29.833094 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 49/88] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:29 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:29.952752 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d8d274b1-37eb-40fc-84a0-fc4a0f631ec2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:29.953540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d8d274b1-37eb-40fc-84a0-fc4a0f631ec2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:29.964736 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8d274b1-37eb-40fc-84a0-fc4a0f631ec2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.965183 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8d274b1-37eb-40fc-84a0-fc4a0f631ec2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.966406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8d274b1-37eb-40fc-84a0-fc4a0f631ec2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.967119 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8d274b1-37eb-40fc-84a0-fc4a0f631ec2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.151870 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-fc5828ef-08ae-4d58-8e30-bafd00088d6b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:30.170295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-fc5828ef-08ae-4d58-8e30-bafd00088d6b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.393578 May 26 18:18:30.172405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 40/89] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:29 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:30.208179 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d8d274b1-37eb-40fc-84a0-fc4a0f631ec2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:30.218645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d8d274b1-37eb-40fc-84a0-fc4a0f631ec2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.267939 May 26 18:18:30.218645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 50/90] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:29 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:30.839176 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-dcbb135a-c597-4928-8704-676ee516a8ce tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:30.840318 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-dcbb135a-c597-4928-8704-676ee516a8ce tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:30.847380 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dcbb135a-c597-4928-8704-676ee516a8ce tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:30.848029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dcbb135a-c597-4928-8704-676ee516a8ce tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.848795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dcbb135a-c597-4928-8704-676ee516a8ce tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:30.849222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dcbb135a-c597-4928-8704-676ee516a8ce tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.987552 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-dcbb135a-c597-4928-8704-676ee516a8ce tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:30.995821 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-dcbb135a-c597-4928-8704-676ee516a8ce tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1557 microversion: 2.1 time: 0.160806 May 26 18:18:30.996396 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 41/91] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:30 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:31.013872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-03cf9a96-3b11-4aa0-ad22-c9833c4fbf09 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:31.014513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-03cf9a96-3b11-4aa0-ad22-c9833c4fbf09 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:31.021865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-03cf9a96-3b11-4aa0-ad22-c9833c4fbf09 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:31.022319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-03cf9a96-3b11-4aa0-ad22-c9833c4fbf09 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:31.023086 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-03cf9a96-3b11-4aa0-ad22-c9833c4fbf09 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:31.023521 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-03cf9a96-3b11-4aa0-ad22-c9833c4fbf09 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:31.153401 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-03cf9a96-3b11-4aa0-ad22-c9833c4fbf09 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143795 May 26 18:18:31.154042 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 51/92] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 18:18:31 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:31.188958 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f500dc99-d01b-48d0-87cf-cb35ccd83687 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:31.189712 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f500dc99-d01b-48d0-87cf-cb35ccd83687 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:31.195945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f500dc99-d01b-48d0-87cf-cb35ccd83687 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:31.196508 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f500dc99-d01b-48d0-87cf-cb35ccd83687 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:31.197288 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f500dc99-d01b-48d0-87cf-cb35ccd83687 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:31.197763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f500dc99-d01b-48d0-87cf-cb35ccd83687 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:31.235626 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7800d229-b931-4c7c-ab49-2bf61f420cd1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:31.236249 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7800d229-b931-4c7c-ab49-2bf61f420cd1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:31.242732 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7800d229-b931-4c7c-ab49-2bf61f420cd1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:31.243185 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7800d229-b931-4c7c-ab49-2bf61f420cd1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:31.244118 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7800d229-b931-4c7c-ab49-2bf61f420cd1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:31.244567 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7800d229-b931-4c7c-ab49-2bf61f420cd1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:31.761486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f500dc99-d01b-48d0-87cf-cb35ccd83687 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:31.771973 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f500dc99-d01b-48d0-87cf-cb35ccd83687 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.587295 May 26 18:18:31.783066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 42/93] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:31 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:31.816497 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7800d229-b931-4c7c-ab49-2bf61f420cd1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:31.845135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7800d229-b931-4c7c-ab49-2bf61f420cd1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.610204 May 26 18:18:31.852598 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 52/94] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:31 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:32.655883 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-484a0c60-5201-46eb-9d03-2167b769a14c req-a5752a8c-37e7-42fc-9c21-5b061784d881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158ce769-fde9-413e-81f3-d76b3222b5fc", "tag": "d8a8f1c3-9b31-4ff3-a2a8-371608a6812a"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:32.665655 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-484a0c60-5201-46eb-9d03-2167b769a14c req-a5752a8c-37e7-42fc-9c21-5b061784d881 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:32.666182 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-484a0c60-5201-46eb-9d03-2167b769a14c req-a5752a8c-37e7-42fc-9c21-5b061784d881 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:32.678049 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-484a0c60-5201-46eb-9d03-2167b769a14c req-a5752a8c-37e7-42fc-9c21-5b061784d881 service nova] Creating event network-changed:d8a8f1c3-9b31-4ff3-a2a8-371608a6812a for instance 158ce769-fde9-413e-81f3-d76b3222b5fc on hv-cinder-84349 May 26 18:18:32.682830 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-484a0c60-5201-46eb-9d03-2167b769a14c req-a5752a8c-37e7-42fc-9c21-5b061784d881 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030570 May 26 18:18:32.683423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 43/95] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:32.789296 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-20e4cedc-be00-4229-9a78-148483578d0d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:32.790208 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-20e4cedc-be00-4229-9a78-148483578d0d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:32.796677 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-20e4cedc-be00-4229-9a78-148483578d0d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:32.797205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-20e4cedc-be00-4229-9a78-148483578d0d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:32.798100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-20e4cedc-be00-4229-9a78-148483578d0d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:32.798995 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-20e4cedc-be00-4229-9a78-148483578d0d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:32.863928 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d73b36c3-0ecd-4665-9d07-b382e623ef87 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:32.864905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d73b36c3-0ecd-4665-9d07-b382e623ef87 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:32.871646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d73b36c3-0ecd-4665-9d07-b382e623ef87 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:32.872429 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d73b36c3-0ecd-4665-9d07-b382e623ef87 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:32.873412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d73b36c3-0ecd-4665-9d07-b382e623ef87 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:32.874106 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d73b36c3-0ecd-4665-9d07-b382e623ef87 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:33.049007 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d73b36c3-0ecd-4665-9d07-b382e623ef87 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:33.053228 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-20e4cedc-be00-4229-9a78-148483578d0d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:33.057657 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d73b36c3-0ecd-4665-9d07-b382e623ef87 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.198734 May 26 18:18:33.058789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 44/96] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:32 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:33.060689 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-20e4cedc-be00-4229-9a78-148483578d0d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.275299 May 26 18:18:33.061262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 53/97] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:32 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:33.063389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-a6ea9db7-6b21-4a02-8249-0e8f235b7c14 req-c431aeae-5497-472d-a6c4-83dc22d7d9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5318d4c9-f954-4123-b0ce-d2b418f37dd3", "name": "network-vif-plugged", "status": "completed", "tag": "e97a903b-46cf-40f9-9aed-884e6e491c98"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:33.072288 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a6ea9db7-6b21-4a02-8249-0e8f235b7c14 req-c431aeae-5497-472d-a6c4-83dc22d7d9b5 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:33.072975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a6ea9db7-6b21-4a02-8249-0e8f235b7c14 req-c431aeae-5497-472d-a6c4-83dc22d7d9b5 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:33.085503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-a6ea9db7-6b21-4a02-8249-0e8f235b7c14 req-c431aeae-5497-472d-a6c4-83dc22d7d9b5 service nova] Creating event network-vif-plugged:e97a903b-46cf-40f9-9aed-884e6e491c98 for instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 on hv-cinder-84349 May 26 18:18:33.090547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-a6ea9db7-6b21-4a02-8249-0e8f235b7c14 req-c431aeae-5497-472d-a6c4-83dc22d7d9b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030577 May 26 18:18:33.091221 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 45/98] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:34.077356 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9c4b292b-655a-4f5e-86a1-2acfd6246f46 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:34.078012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9c4b292b-655a-4f5e-86a1-2acfd6246f46 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:34.084991 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-da25c315-b515-4c3d-8b21-1dc1cb7bd2ef tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:34.086058 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-da25c315-b515-4c3d-8b21-1dc1cb7bd2ef tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:34.090047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9c4b292b-655a-4f5e-86a1-2acfd6246f46 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:34.090512 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9c4b292b-655a-4f5e-86a1-2acfd6246f46 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:34.091351 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9c4b292b-655a-4f5e-86a1-2acfd6246f46 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:34.091785 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9c4b292b-655a-4f5e-86a1-2acfd6246f46 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:34.111299 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-da25c315-b515-4c3d-8b21-1dc1cb7bd2ef tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:34.111841 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-da25c315-b515-4c3d-8b21-1dc1cb7bd2ef tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:34.112986 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-da25c315-b515-4c3d-8b21-1dc1cb7bd2ef tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:34.113570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-da25c315-b515-4c3d-8b21-1dc1cb7bd2ef tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:34.304023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-da25c315-b515-4c3d-8b21-1dc1cb7bd2ef tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:34.314657 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-da25c315-b515-4c3d-8b21-1dc1cb7bd2ef tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.239665 May 26 18:18:34.315461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 46/99] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:34 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:34.636647 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9c4b292b-655a-4f5e-86a1-2acfd6246f46 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:34.644612 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9c4b292b-655a-4f5e-86a1-2acfd6246f46 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.572493 May 26 18:18:34.645194 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 54/100] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:34 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:35.331447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-009ac976-cb28-4256-b07d-da921e485df4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:35.332058 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-009ac976-cb28-4256-b07d-da921e485df4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:35.338642 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-009ac976-cb28-4256-b07d-da921e485df4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:35.339094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-009ac976-cb28-4256-b07d-da921e485df4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:35.339851 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-009ac976-cb28-4256-b07d-da921e485df4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:35.340285 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-009ac976-cb28-4256-b07d-da921e485df4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:35.344251 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:35.478043 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-009ac976-cb28-4256-b07d-da921e485df4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:35.485463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-009ac976-cb28-4256-b07d-da921e485df4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.157850 May 26 18:18:35.486068 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 47/101] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:35 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:35.660799 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c9d47527-8db7-4ed5-895d-9e9a1e38247a tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:35.661407 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c9d47527-8db7-4ed5-895d-9e9a1e38247a tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:35.667491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9d47527-8db7-4ed5-895d-9e9a1e38247a tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:35.667941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9d47527-8db7-4ed5-895d-9e9a1e38247a tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:35.668695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9d47527-8db7-4ed5-895d-9e9a1e38247a tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:35.669128 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9d47527-8db7-4ed5-895d-9e9a1e38247a tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:35.803930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c9d47527-8db7-4ed5-895d-9e9a1e38247a tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:35.811262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c9d47527-8db7-4ed5-895d-9e9a1e38247a tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.154815 May 26 18:18:35.811960 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 55/102] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:35 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:36.507563 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6d16393e-6354-4ae7-ae45-21d7001a04d1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:36.508185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6d16393e-6354-4ae7-ae45-21d7001a04d1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:36.514694 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6d16393e-6354-4ae7-ae45-21d7001a04d1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:36.515154 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6d16393e-6354-4ae7-ae45-21d7001a04d1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:36.515924 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6d16393e-6354-4ae7-ae45-21d7001a04d1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:36.516365 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6d16393e-6354-4ae7-ae45-21d7001a04d1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:36.644255 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6d16393e-6354-4ae7-ae45-21d7001a04d1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:36.651658 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6d16393e-6354-4ae7-ae45-21d7001a04d1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.147961 May 26 18:18:36.652242 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 48/103] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:36 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:36.828103 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-462b0fe5-5fb8-4421-9035-82246b948095 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:36.828714 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-462b0fe5-5fb8-4421-9035-82246b948095 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:36.834926 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-462b0fe5-5fb8-4421-9035-82246b948095 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:36.835379 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-462b0fe5-5fb8-4421-9035-82246b948095 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:36.836142 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-462b0fe5-5fb8-4421-9035-82246b948095 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:36.836583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-462b0fe5-5fb8-4421-9035-82246b948095 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:36.998705 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-462b0fe5-5fb8-4421-9035-82246b948095 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:37.006316 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-462b0fe5-5fb8-4421-9035-82246b948095 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.182020 May 26 18:18:37.006906 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 56/104] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:36 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:37.629984 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-4f89c93a-c353-495a-a3c5-0312557765b3 req-e0019910-1aa4-4190-abb6-eaf2c090a223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1715d8f6-ce4b-48d3-96b0-0717bc0ac54a", "name": "network-vif-plugged", "status": "completed", "tag": "5791c3dc-854e-4168-8bdd-187fa96c5f33"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:37.638685 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-4f89c93a-c353-495a-a3c5-0312557765b3 req-e0019910-1aa4-4190-abb6-eaf2c090a223 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:37.639171 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-4f89c93a-c353-495a-a3c5-0312557765b3 req-e0019910-1aa4-4190-abb6-eaf2c090a223 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:37.651705 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-4f89c93a-c353-495a-a3c5-0312557765b3 req-e0019910-1aa4-4190-abb6-eaf2c090a223 service nova] Creating event network-vif-plugged:5791c3dc-854e-4168-8bdd-187fa96c5f33 for instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a on hv-cinder-84349 May 26 18:18:37.656636 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-4f89c93a-c353-495a-a3c5-0312557765b3 req-e0019910-1aa4-4190-abb6-eaf2c090a223 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030825 May 26 18:18:37.657988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 49/105] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:18:37.668228 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e1836c31-22d9-42ff-a7e3-ba5f744b093e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:37.668869 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e1836c31-22d9-42ff-a7e3-ba5f744b093e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:37.676655 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e1836c31-22d9-42ff-a7e3-ba5f744b093e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:37.677125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e1836c31-22d9-42ff-a7e3-ba5f744b093e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:37.678033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e1836c31-22d9-42ff-a7e3-ba5f744b093e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:37.678467 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e1836c31-22d9-42ff-a7e3-ba5f744b093e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:37.889589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e1836c31-22d9-42ff-a7e3-ba5f744b093e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:37.898321 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e1836c31-22d9-42ff-a7e3-ba5f744b093e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1322 microversion: 2.1 time: 0.233922 May 26 18:18:37.899606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 57/106] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:37 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:38.025240 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6ef010a6-ead4-4f8d-80ef-b068644c5837 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:38.026053 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6ef010a6-ead4-4f8d-80ef-b068644c5837 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:38.028525 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=76 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:38.035151 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6ef010a6-ead4-4f8d-80ef-b068644c5837 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:38.035606 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6ef010a6-ead4-4f8d-80ef-b068644c5837 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:38.036380 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6ef010a6-ead4-4f8d-80ef-b068644c5837 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:38.036819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6ef010a6-ead4-4f8d-80ef-b068644c5837 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:38.176506 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6ef010a6-ead4-4f8d-80ef-b068644c5837 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:38.183766 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6ef010a6-ead4-4f8d-80ef-b068644c5837 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.163406 May 26 18:18:38.184343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 50/107] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:38 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:38.919327 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8daa6bf0-66f9-4d2f-986f-13e4fd6c1cc0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:38.922368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8daa6bf0-66f9-4d2f-986f-13e4fd6c1cc0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:38.932636 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8daa6bf0-66f9-4d2f-986f-13e4fd6c1cc0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:38.933631 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8daa6bf0-66f9-4d2f-986f-13e4fd6c1cc0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:38.934458 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8daa6bf0-66f9-4d2f-986f-13e4fd6c1cc0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:38.935070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8daa6bf0-66f9-4d2f-986f-13e4fd6c1cc0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:39.107409 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8daa6bf0-66f9-4d2f-986f-13e4fd6c1cc0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:39.115982 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8daa6bf0-66f9-4d2f-986f-13e4fd6c1cc0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1517 microversion: 2.1 time: 0.201630 May 26 18:18:39.125790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 58/108] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:38 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:39.133703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d11fdc6e-884e-4fe2-9703-938f6668c47d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:39.134677 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d11fdc6e-884e-4fe2-9703-938f6668c47d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:39.141057 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d11fdc6e-884e-4fe2-9703-938f6668c47d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:39.141512 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d11fdc6e-884e-4fe2-9703-938f6668c47d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:39.142416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d11fdc6e-884e-4fe2-9703-938f6668c47d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:39.142865 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d11fdc6e-884e-4fe2-9703-938f6668c47d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:39.169362 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-d11fdc6e-884e-4fe2-9703-938f6668c47d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lazy-loading 'flavor' on Instance uuid 5318d4c9-f954-4123-b0ce-d2b418f37dd3 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:18:39.201325 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-90aa0a66-fb35-4452-9716-e79304b456d2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:39.202838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-90aa0a66-fb35-4452-9716-e79304b456d2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:39.209689 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90aa0a66-fb35-4452-9716-e79304b456d2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:39.210352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90aa0a66-fb35-4452-9716-e79304b456d2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:39.211234 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90aa0a66-fb35-4452-9716-e79304b456d2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:39.212309 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-90aa0a66-fb35-4452-9716-e79304b456d2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:39.244394 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:39.316113 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d11fdc6e-884e-4fe2-9703-938f6668c47d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3/action" status: 200 len: 32 microversion: 2.1 time: 0.186401 May 26 18:18:39.316824 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 51/109] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:18:39 2022] POST /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:18:39.327155 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-07241a4d-15da-4781-8a14-22c2bebc72a2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:39.327862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-07241a4d-15da-4781-8a14-22c2bebc72a2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:39.335161 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-07241a4d-15da-4781-8a14-22c2bebc72a2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:39.335563 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-07241a4d-15da-4781-8a14-22c2bebc72a2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:39.336481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-07241a4d-15da-4781-8a14-22c2bebc72a2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:39.337098 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-07241a4d-15da-4781-8a14-22c2bebc72a2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:39.459342 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-90aa0a66-fb35-4452-9716-e79304b456d2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:39.467880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-90aa0a66-fb35-4452-9716-e79304b456d2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1364 microversion: 2.1 time: 0.271195 May 26 18:18:39.468511 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 59/110] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:39 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:39.580679 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-07241a4d-15da-4781-8a14-22c2bebc72a2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:39.591195 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-07241a4d-15da-4781-8a14-22c2bebc72a2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.268786 May 26 18:18:39.591795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 52/111] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:39 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:40.487809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-aba58008-8d69-421b-9e99-6c073697b50f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:40.488439 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-aba58008-8d69-421b-9e99-6c073697b50f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:40.495445 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aba58008-8d69-421b-9e99-6c073697b50f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:40.495900 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aba58008-8d69-421b-9e99-6c073697b50f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:40.496665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aba58008-8d69-421b-9e99-6c073697b50f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:40.497102 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aba58008-8d69-421b-9e99-6c073697b50f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:40.623235 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ad79ee55-2934-4864-9630-1cc2067bfb04 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:40.624777 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ad79ee55-2934-4864-9630-1cc2067bfb04 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:40.653342 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ad79ee55-2934-4864-9630-1cc2067bfb04 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:40.653906 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ad79ee55-2934-4864-9630-1cc2067bfb04 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:40.654888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ad79ee55-2934-4864-9630-1cc2067bfb04 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:40.655497 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ad79ee55-2934-4864-9630-1cc2067bfb04 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:40.663397 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-aba58008-8d69-421b-9e99-6c073697b50f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:40.675763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-aba58008-8d69-421b-9e99-6c073697b50f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1550 microversion: 2.1 time: 0.190027 May 26 18:18:40.675763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 60/112] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:40 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1550 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:40.693429 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-400e9b08-692f-42e7-bb80-3cd9821a966b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:40.694154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-400e9b08-692f-42e7-bb80-3cd9821a966b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:40.701358 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-400e9b08-692f-42e7-bb80-3cd9821a966b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:40.702025 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-400e9b08-692f-42e7-bb80-3cd9821a966b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:40.703172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-400e9b08-692f-42e7-bb80-3cd9821a966b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:40.703918 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-400e9b08-692f-42e7-bb80-3cd9821a966b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:40.916707 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-400e9b08-692f-42e7-bb80-3cd9821a966b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.229485 May 26 18:18:40.918043 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 61/113] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 18:18:40 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:18:41.000930 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ad79ee55-2934-4864-9630-1cc2067bfb04 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:41.010961 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ad79ee55-2934-4864-9630-1cc2067bfb04 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.406219 May 26 18:18:41.012870 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 53/114] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:40 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:42.032120 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8b5636e2-42e5-49a7-a3f5-652de446fbc2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:42.033468 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8b5636e2-42e5-49a7-a3f5-652de446fbc2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:42.040319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b5636e2-42e5-49a7-a3f5-652de446fbc2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:42.040811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b5636e2-42e5-49a7-a3f5-652de446fbc2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:42.041578 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b5636e2-42e5-49a7-a3f5-652de446fbc2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:42.042041 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b5636e2-42e5-49a7-a3f5-652de446fbc2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:42.188611 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8b5636e2-42e5-49a7-a3f5-652de446fbc2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:42.199140 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8b5636e2-42e5-49a7-a3f5-652de446fbc2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.171422 May 26 18:18:42.200061 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 62/115] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:42 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:42.777342 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-1de7d750-0d89-4c4c-9360-bf82ba22b11f req-f1dc647b-d430-47a8-9608-177e670505c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1715d8f6-ce4b-48d3-96b0-0717bc0ac54a", "tag": "5791c3dc-854e-4168-8bdd-187fa96c5f33"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:42.786218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-1de7d750-0d89-4c4c-9360-bf82ba22b11f req-f1dc647b-d430-47a8-9608-177e670505c2 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:42.786996 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-1de7d750-0d89-4c4c-9360-bf82ba22b11f req-f1dc647b-d430-47a8-9608-177e670505c2 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:42.801113 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-1de7d750-0d89-4c4c-9360-bf82ba22b11f req-f1dc647b-d430-47a8-9608-177e670505c2 service nova] Creating event network-changed:5791c3dc-854e-4168-8bdd-187fa96c5f33 for instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a on hv-cinder-84349 May 26 18:18:42.807372 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-1de7d750-0d89-4c4c-9360-bf82ba22b11f req-f1dc647b-d430-47a8-9608-177e670505c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033684 May 26 18:18:42.808406 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 54/116] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:43.220028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1a786f21-83bc-4b54-bcf7-021dc163c6f3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:43.221574 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1a786f21-83bc-4b54-bcf7-021dc163c6f3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:43.231385 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a786f21-83bc-4b54-bcf7-021dc163c6f3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:43.232492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a786f21-83bc-4b54-bcf7-021dc163c6f3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:43.234022 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a786f21-83bc-4b54-bcf7-021dc163c6f3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:43.235023 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a786f21-83bc-4b54-bcf7-021dc163c6f3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:43.458482 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1a786f21-83bc-4b54-bcf7-021dc163c6f3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:43.468347 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1a786f21-83bc-4b54-bcf7-021dc163c6f3 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.251999 May 26 18:18:43.469680 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 63/117] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:43 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:44.488484 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9ba8f10b-471d-44e8-b411-3e30bd5be38a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:44.490133 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9ba8f10b-471d-44e8-b411-3e30bd5be38a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:44.497755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9ba8f10b-471d-44e8-b411-3e30bd5be38a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:44.498468 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9ba8f10b-471d-44e8-b411-3e30bd5be38a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:44.499441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9ba8f10b-471d-44e8-b411-3e30bd5be38a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:44.500221 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9ba8f10b-471d-44e8-b411-3e30bd5be38a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:44.686268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9ba8f10b-471d-44e8-b411-3e30bd5be38a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:44.696519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9ba8f10b-471d-44e8-b411-3e30bd5be38a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.213683 May 26 18:18:44.697115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 55/118] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:44 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:45.714057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4cb2b70d-d8bc-4990-90c2-ab170a55faeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:45.714745 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4cb2b70d-d8bc-4990-90c2-ab170a55faeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:45.721209 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4cb2b70d-d8bc-4990-90c2-ab170a55faeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:45.722026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4cb2b70d-d8bc-4990-90c2-ab170a55faeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:45.722945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4cb2b70d-d8bc-4990-90c2-ab170a55faeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:45.723456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4cb2b70d-d8bc-4990-90c2-ab170a55faeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:45.875673 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4cb2b70d-d8bc-4990-90c2-ab170a55faeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:45.885446 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4cb2b70d-d8bc-4990-90c2-ab170a55faeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.176087 May 26 18:18:45.886216 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 64/119] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:45 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:46.904004 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-68cd535d-7fe7-4a2f-bc22-937121a0ff41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:46.905073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-68cd535d-7fe7-4a2f-bc22-937121a0ff41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:46.913717 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-68cd535d-7fe7-4a2f-bc22-937121a0ff41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:46.914235 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-68cd535d-7fe7-4a2f-bc22-937121a0ff41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:46.914954 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-68cd535d-7fe7-4a2f-bc22-937121a0ff41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:46.915409 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-68cd535d-7fe7-4a2f-bc22-937121a0ff41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:47.078541 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-68cd535d-7fe7-4a2f-bc22-937121a0ff41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:47.086913 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-68cd535d-7fe7-4a2f-bc22-937121a0ff41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.187387 May 26 18:18:47.087818 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 56/120] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:46 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:48.109414 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f32a555c-01c2-4e35-afc6-09965dd2d120 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:48.110371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f32a555c-01c2-4e35-afc6-09965dd2d120 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:48.121569 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=76 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:48.123282 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f32a555c-01c2-4e35-afc6-09965dd2d120 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:48.124127 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f32a555c-01c2-4e35-afc6-09965dd2d120 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:48.125025 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f32a555c-01c2-4e35-afc6-09965dd2d120 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:48.125690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f32a555c-01c2-4e35-afc6-09965dd2d120 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:48.350347 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7baefaa4-2c94-49c2-8c42-c33986d89786 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:48.352188 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7baefaa4-2c94-49c2-8c42-c33986d89786 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:48.359659 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7baefaa4-2c94-49c2-8c42-c33986d89786 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:48.360121 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7baefaa4-2c94-49c2-8c42-c33986d89786 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:48.361701 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7baefaa4-2c94-49c2-8c42-c33986d89786 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:48.362449 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7baefaa4-2c94-49c2-8c42-c33986d89786 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:48.392980 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7baefaa4-2c94-49c2-8c42-c33986d89786 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:18:48.440364 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f32a555c-01c2-4e35-afc6-09965dd2d120 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:48.471816 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f32a555c-01c2-4e35-afc6-09965dd2d120 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.366175 May 26 18:18:48.473700 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 65/121] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:48 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:48.506466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7baefaa4-2c94-49c2-8c42-c33986d89786 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 204 len: 0 microversion: 2.1 time: 0.159571 May 26 18:18:48.507621 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 57/122] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:18:48 2022] DELETE /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:18:48.516495 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-859853e0-0224-47d3-a47a-03af0f664e6a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:48.517891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-859853e0-0224-47d3-a47a-03af0f664e6a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:48.525555 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-859853e0-0224-47d3-a47a-03af0f664e6a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:48.526242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-859853e0-0224-47d3-a47a-03af0f664e6a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:48.527227 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-859853e0-0224-47d3-a47a-03af0f664e6a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:48.527819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-859853e0-0224-47d3-a47a-03af0f664e6a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:48.697377 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-859853e0-0224-47d3-a47a-03af0f664e6a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:48.709426 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-859853e0-0224-47d3-a47a-03af0f664e6a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1551 microversion: 2.1 time: 0.197262 May 26 18:18:48.718225 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 66/123] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:48 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1551 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:49.491111 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c81b8635-033b-4828-afc0-393b1c120831 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:49.492493 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c81b8635-033b-4828-afc0-393b1c120831 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:49.500343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c81b8635-033b-4828-afc0-393b1c120831 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:49.501096 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c81b8635-033b-4828-afc0-393b1c120831 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:49.502886 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c81b8635-033b-4828-afc0-393b1c120831 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:49.503402 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c81b8635-033b-4828-afc0-393b1c120831 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:49.648952 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c81b8635-033b-4828-afc0-393b1c120831 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:49.656635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c81b8635-033b-4828-afc0-393b1c120831 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.170543 May 26 18:18:49.657213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 58/124] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:49 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:49.725303 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-540a557e-d868-4266-8a4f-d2a46f7bcf08 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:49.726056 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-540a557e-d868-4266-8a4f-d2a46f7bcf08 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:49.732124 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-540a557e-d868-4266-8a4f-d2a46f7bcf08 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:49.732652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-540a557e-d868-4266-8a4f-d2a46f7bcf08 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:49.733508 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-540a557e-d868-4266-8a4f-d2a46f7bcf08 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:49.734024 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-540a557e-d868-4266-8a4f-d2a46f7bcf08 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:49.872117 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-540a557e-d868-4266-8a4f-d2a46f7bcf08 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:49.882664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-540a557e-d868-4266-8a4f-d2a46f7bcf08 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1551 microversion: 2.1 time: 0.161095 May 26 18:18:49.883301 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 67/125] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:49 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:50.672909 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-62537cf5-ddf7-4ff1-a237-2d42c45f6233 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:50.675299 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-62537cf5-ddf7-4ff1-a237-2d42c45f6233 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:50.683208 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62537cf5-ddf7-4ff1-a237-2d42c45f6233 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:50.683920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62537cf5-ddf7-4ff1-a237-2d42c45f6233 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:50.684865 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62537cf5-ddf7-4ff1-a237-2d42c45f6233 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:50.685470 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62537cf5-ddf7-4ff1-a237-2d42c45f6233 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:50.899858 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-36650665-f879-483d-8e8e-c981ad7d7c06 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:50.900576 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-36650665-f879-483d-8e8e-c981ad7d7c06 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:50.907797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-36650665-f879-483d-8e8e-c981ad7d7c06 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:50.908348 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-36650665-f879-483d-8e8e-c981ad7d7c06 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:50.909238 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-36650665-f879-483d-8e8e-c981ad7d7c06 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:50.909765 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-36650665-f879-483d-8e8e-c981ad7d7c06 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:51.375605 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-62537cf5-ddf7-4ff1-a237-2d42c45f6233 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:51.383503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-62537cf5-ddf7-4ff1-a237-2d42c45f6233 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.714633 May 26 18:18:51.384089 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 59/126] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:50 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:51.496211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-36650665-f879-483d-8e8e-c981ad7d7c06 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:51.509895 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-36650665-f879-483d-8e8e-c981ad7d7c06 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1551 microversion: 2.1 time: 0.613899 May 26 18:18:51.511183 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 68/127] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:50 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1551 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:51.953931 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-2c56eb44-6837-4791-b738-31519800a636 req-06738609-58bb-4e3f-96ce-a550bab45f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e", "name": "network-vif-deleted", "tag": "2ec1e990-e50a-44d3-aeb8-f9a33c92c72b"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:51.972535 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-2c56eb44-6837-4791-b738-31519800a636 req-06738609-58bb-4e3f-96ce-a550bab45f64 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:51.976230 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-2c56eb44-6837-4791-b738-31519800a636 req-06738609-58bb-4e3f-96ce-a550bab45f64 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:51.990087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-2c56eb44-6837-4791-b738-31519800a636 req-06738609-58bb-4e3f-96ce-a550bab45f64 service nova] Creating event network-vif-deleted:2ec1e990-e50a-44d3-aeb8-f9a33c92c72b for instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e on hv-cinder-84349 May 26 18:18:51.995847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-2c56eb44-6837-4791-b738-31519800a636 req-06738609-58bb-4e3f-96ce-a550bab45f64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048257 May 26 18:18:51.997213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 60/128] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:52.400262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0f22c99b-49f1-4dad-824e-d38755d52276 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:52.400928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0f22c99b-49f1-4dad-824e-d38755d52276 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:52.431410 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0f22c99b-49f1-4dad-824e-d38755d52276 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:52.432735 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0f22c99b-49f1-4dad-824e-d38755d52276 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:52.434458 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0f22c99b-49f1-4dad-824e-d38755d52276 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:52.435125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0f22c99b-49f1-4dad-824e-d38755d52276 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:52.530496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:52.531834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:52.539194 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:52.539972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:52.541496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:52.542379 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:52.602023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:52.602577 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:52.603131 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lazy-loading 'fault' on Instance uuid 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:18:52.697228 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02438387c012405eb258a65311c092a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65ddb707cf4a3991b4797726d1336e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:52.702062 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:52.710621 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0f22c99b-49f1-4dad-824e-d38755d52276 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:52.727664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0f22c99b-49f1-4dad-824e-d38755d52276 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.328723 May 26 18:18:52.728972 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 69/129] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:52 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:52.742706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-202dd426-10f4-4b6d-b5f4-00787688be72 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 200 len: 1349 microversion: 2.1 time: 0.217340 May 26 18:18:52.743664 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 61/130] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:52 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 1349 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:53.748353 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f87f2d8b-ead9-46e5-bdea-343f22018c39 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:53.749018 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f87f2d8b-ead9-46e5-bdea-343f22018c39 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:53.755440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f87f2d8b-ead9-46e5-bdea-343f22018c39 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:53.756108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f87f2d8b-ead9-46e5-bdea-343f22018c39 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:53.756888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f87f2d8b-ead9-46e5-bdea-343f22018c39 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:53.757481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f87f2d8b-ead9-46e5-bdea-343f22018c39 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:53.761071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:53.762348 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:53.780531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:53.780531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:53.780531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:53.780531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:53.804153 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] HTTP exception thrown: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Request method failure captured: May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e HTTP/1.1 May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RALLFIYrZiVRs3c-TiHHNiy4CH5PH6dC_McqgFJR6qwf9eK_mZuZO34bEI6rCm58x9qLPXC2RsZESPKU3oUrMArfJxQlRWnbnqaUgUb6mCJVIv2UjG8i5HahDlLrPvcQph9-1Gkwtiz4YbczPM9bRGge4S8LdMd352KpwMsDzEj3s May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 3f65ddb707cf4a3991b4797726d1336e May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:18:53.816023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3f65ddb707cf4a3991b4797726d1336e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 3f65ddb707cf4a3991b4797726d1336e May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-DeleteServersTestJSON-1996024988-project May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 02438387c012405eb258a65311c092a5 May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-DeleteServersTestJSON-1996024988-project May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:53.817373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e'} May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:53.818123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:53.819422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:53.822577 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Returning 404 to user: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:53.825495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5f61c492-dd6f-4b8d-89b9-ea868e10911e tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 404 len: 111 microversion: 2.1 time: 0.066899 May 26 18:18:53.827288 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 62/131] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:53 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:53.979197 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f87f2d8b-ead9-46e5-bdea-343f22018c39 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:53.989872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f87f2d8b-ead9-46e5-bdea-343f22018c39 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.243191 May 26 18:18:53.990303 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:53.991066 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 70/132] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:53 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:53.999864 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:54.011915 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:54.012365 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:54.013296 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:54.013754 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:54.028425 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] HTTP exception thrown: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Request method failure captured: May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e/os-volume_attachments HTTP/1.1 May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RALLFIYrZiVRs3c-TiHHNiy4CH5PH6dC_McqgFJR6qwf9eK_mZuZO34bEI6rCm58x9qLPXC2RsZESPKU3oUrMArfJxQlRWnbnqaUgUb6mCJVIv2UjG8i5HahDlLrPvcQph9-1Gkwtiz4YbczPM9bRGge4S8LdMd352KpwMsDzEj3s May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 3f65ddb707cf4a3991b4797726d1336e May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:18:54.035988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3f65ddb707cf4a3991b4797726d1336e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 3f65ddb707cf4a3991b4797726d1336e May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-DeleteServersTestJSON-1996024988-project May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 02438387c012405eb258a65311c092a5 May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-DeleteServersTestJSON-1996024988-project May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:54.037416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'server_id': '9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e'} May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:54.038198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:54.039405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:54.042140 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Returning 404 to user: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:54.043624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e520dade-7332-4f19-920c-40035ec5503f tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057569 May 26 18:18:54.044613 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 63/133] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:18:53 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e/os-volume_attachments => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:18:55.008489 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c4602ffa-0440-4e42-8a0a-bead490d4cbb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:55.009101 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c4602ffa-0440-4e42-8a0a-bead490d4cbb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:55.018077 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c4602ffa-0440-4e42-8a0a-bead490d4cbb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:55.018646 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c4602ffa-0440-4e42-8a0a-bead490d4cbb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:55.019826 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c4602ffa-0440-4e42-8a0a-bead490d4cbb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:55.020264 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c4602ffa-0440-4e42-8a0a-bead490d4cbb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:55.175581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c4602ffa-0440-4e42-8a0a-bead490d4cbb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:55.184202 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c4602ffa-0440-4e42-8a0a-bead490d4cbb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.179391 May 26 18:18:55.185615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 71/134] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:55 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:55.285405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:55.286755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:55.295086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:55.295737 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:55.296931 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:55.297611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:55.313561 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] HTTP exception thrown: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Request method failure captured: May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: DELETE /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e HTTP/1.1 May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RALLFIYrZiVRs3c-TiHHNiy4CH5PH6dC_McqgFJR6qwf9eK_mZuZO34bEI6rCm58x9qLPXC2RsZESPKU3oUrMArfJxQlRWnbnqaUgUb6mCJVIv2UjG8i5HahDlLrPvcQph9-1Gkwtiz4YbczPM9bRGge4S8LdMd352KpwMsDzEj3s May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 3f65ddb707cf4a3991b4797726d1336e May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:18:55.316086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3f65ddb707cf4a3991b4797726d1336e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 3f65ddb707cf4a3991b4797726d1336e May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-DeleteServersTestJSON-1996024988-project May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 02438387c012405eb258a65311c092a5 May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-DeleteServersTestJSON-1996024988-project May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.317292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e'} May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:55.317975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.318995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:18:55.320841 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Returning 404 to user: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:55.321718 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-649897a4-00ab-4f49-8b23-159ef86cdaf6 tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 404 len: 111 microversion: 2.1 time: 0.041504 May 26 18:18:55.331037 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:55.331774 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] [instance: 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:55.333892 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 64/135] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:18:55 2022] DELETE /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:55.338846 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:55.339501 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:55.340499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:55.341208 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:55.360881 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] HTTP exception thrown: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Request method failure captured: May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e HTTP/1.1 May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RALLFIYrZiVRs3c-TiHHNiy4CH5PH6dC_McqgFJR6qwf9eK_mZuZO34bEI6rCm58x9qLPXC2RsZESPKU3oUrMArfJxQlRWnbnqaUgUb6mCJVIv2UjG8i5HahDlLrPvcQph9-1Gkwtiz4YbczPM9bRGge4S8LdMd352KpwMsDzEj3s May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 3f65ddb707cf4a3991b4797726d1336e May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:18:55.366737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3f65ddb707cf4a3991b4797726d1336e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3f65ddb707cf4a3991b4797726d1336e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 3f65ddb707cf4a3991b4797726d1336e May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996024988 May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-DeleteServersTestJSON-1996024988-project May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 02438387c012405eb258a65311c092a5 May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-DeleteServersTestJSON-1996024988-project May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.367951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e'} May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:55.368580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. May 26 18:18:55.369888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:18:55.370819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] Returning 404 to user: Instance 9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:55.372286 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d19ba049-7575-4093-94e1-ac585e3a773a tempest-DeleteServersTestJSON-1996024988 tempest-DeleteServersTestJSON-1996024988-project] 10.222.0.46 "GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e" status: 404 len: 111 microversion: 2.1 time: 0.041549 May 26 18:18:55.376699 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 72/136] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:55 2022] GET /compute/v2.1/servers/9c1d5c1f-018e-420c-8a1c-3f2a40c42a3e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:56.203362 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-daa9f0f5-b20a-4e6b-aedc-69f93f32b2e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:56.203973 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-daa9f0f5-b20a-4e6b-aedc-69f93f32b2e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:56.210261 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-daa9f0f5-b20a-4e6b-aedc-69f93f32b2e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:56.210717 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-daa9f0f5-b20a-4e6b-aedc-69f93f32b2e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:56.211483 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-daa9f0f5-b20a-4e6b-aedc-69f93f32b2e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:56.211918 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-daa9f0f5-b20a-4e6b-aedc-69f93f32b2e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:56.372523 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-daa9f0f5-b20a-4e6b-aedc-69f93f32b2e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:56.380787 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-daa9f0f5-b20a-4e6b-aedc-69f93f32b2e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.181282 May 26 18:18:56.381469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 65/137] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:56 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:57.398918 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ceaa0b83-8b23-46b5-a9f1-64da14bc2cf5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:57.399526 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ceaa0b83-8b23-46b5-a9f1-64da14bc2cf5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:57.405859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ceaa0b83-8b23-46b5-a9f1-64da14bc2cf5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:57.406487 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ceaa0b83-8b23-46b5-a9f1-64da14bc2cf5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:57.407765 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ceaa0b83-8b23-46b5-a9f1-64da14bc2cf5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:57.408432 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ceaa0b83-8b23-46b5-a9f1-64da14bc2cf5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:57.554675 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ceaa0b83-8b23-46b5-a9f1-64da14bc2cf5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:57.565449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ceaa0b83-8b23-46b5-a9f1-64da14bc2cf5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.170302 May 26 18:18:57.566075 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 73/138] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:57 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:58.583273 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d53dd39e-4290-4c51-b6ba-b879eaebe70b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:58.590297 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d53dd39e-4290-4c51-b6ba-b879eaebe70b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:58.619276 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d53dd39e-4290-4c51-b6ba-b879eaebe70b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:58.619901 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d53dd39e-4290-4c51-b6ba-b879eaebe70b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:58.622917 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d53dd39e-4290-4c51-b6ba-b879eaebe70b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:58.623572 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d53dd39e-4290-4c51-b6ba-b879eaebe70b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:58.832619 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d53dd39e-4290-4c51-b6ba-b879eaebe70b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:58.840867 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d53dd39e-4290-4c51-b6ba-b879eaebe70b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.262094 May 26 18:18:58.851342 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 66/139] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:58 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:59.859000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-69cf4765-1f4f-4c29-9c84-d2b4d32f6d7e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:59.860271 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-69cf4765-1f4f-4c29-9c84-d2b4d32f6d7e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:59.872932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-69cf4765-1f4f-4c29-9c84-d2b4d32f6d7e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:59.873386 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-69cf4765-1f4f-4c29-9c84-d2b4d32f6d7e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:59.877602 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-69cf4765-1f4f-4c29-9c84-d2b4d32f6d7e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:59.878572 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-69cf4765-1f4f-4c29-9c84-d2b4d32f6d7e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:00.107822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-69cf4765-1f4f-4c29-9c84-d2b4d32f6d7e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:00.121994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-69cf4765-1f4f-4c29-9c84-d2b4d32f6d7e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.266495 May 26 18:19:00.123179 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 74/140] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:18:59 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:01.140349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9880e772-0ecd-49f7-a83e-6062c2e196a1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:01.140977 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9880e772-0ecd-49f7-a83e-6062c2e196a1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:01.152380 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9880e772-0ecd-49f7-a83e-6062c2e196a1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:01.153021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9880e772-0ecd-49f7-a83e-6062c2e196a1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:01.154190 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9880e772-0ecd-49f7-a83e-6062c2e196a1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:01.156075 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9880e772-0ecd-49f7-a83e-6062c2e196a1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:01.341196 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9880e772-0ecd-49f7-a83e-6062c2e196a1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:01.353642 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9880e772-0ecd-49f7-a83e-6062c2e196a1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.216800 May 26 18:19:01.355965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 67/141] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:01 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:02.373785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0682da60-c078-4714-82fc-396966e0d767 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:02.374601 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0682da60-c078-4714-82fc-396966e0d767 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:02.390965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0682da60-c078-4714-82fc-396966e0d767 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:02.393948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0682da60-c078-4714-82fc-396966e0d767 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:02.394783 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0682da60-c078-4714-82fc-396966e0d767 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:02.395226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0682da60-c078-4714-82fc-396966e0d767 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:02.479302 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e31e4161-7625-4b68-a66a-ac94e7175365 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'create', calling method: .version_select at 0x7f5f1b58a1f0>, body: {"keypair": {"name": "tempest-keypair-1596646696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4kiYLytPdv7ew9OoL3OD73Kmhdwq+RnjujKOc9eKBPE5HSkZgmjpM1+u2kYdbzmYfPvd34FEkJNcgQFqjp6H1kBScJqz0yI60G32KF9nxAT9OCr0BXxo8hrccKBjawZQ=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:02.513708 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-e31e4161-7625-4b68-a66a-ac94e7175365 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Getting quotas for project 84dc70884aff4a799bb8f38899766e81. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:19:02.519921 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-e31e4161-7625-4b68-a66a-ac94e7175365 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Getting quotas for user 7f2ffbc59c60455cb9cadda081e30381 and project 84dc70884aff4a799bb8f38899766e81. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:19:02.561539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e31e4161-7625-4b68-a66a-ac94e7175365 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.336717 May 26 18:19:02.562740 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 75/142] 10.222.0.46 () {62 vars in 1199 bytes} [Thu May 26 18:19:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 339 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 18:19:02.625235 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0682da60-c078-4714-82fc-396966e0d767 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:02.636620 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0682da60-c078-4714-82fc-396966e0d767 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.267992 May 26 18:19:02.647484 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 68/143] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:02 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:03.656117 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-606bd527-44d2-425c-8e97-e14376ac683f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:03.656751 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-606bd527-44d2-425c-8e97-e14376ac683f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:03.664619 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-606bd527-44d2-425c-8e97-e14376ac683f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:03.665072 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-606bd527-44d2-425c-8e97-e14376ac683f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:03.666102 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-606bd527-44d2-425c-8e97-e14376ac683f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:03.666537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-606bd527-44d2-425c-8e97-e14376ac683f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:03.902156 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-606bd527-44d2-425c-8e97-e14376ac683f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:03.919743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-606bd527-44d2-425c-8e97-e14376ac683f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.267993 May 26 18:19:03.931736 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 76/144] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:03 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:04.528864 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-522341237", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b60b547b-b8f7-49ae-8ba6-53f64d41d871"}], "security_groups": [{"name": "tempest-securitygroup--1623536149"}], "key_name": "tempest-keypair-1596646696", "user_data": "}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:04.648609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] validate_networks() for [('b60b547b-b8f7-49ae-8ba6-53f64d41d871', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:19:04.941067 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-85c04542-9cb7-4e28-901f-e03defb0a76e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:04.942361 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-85c04542-9cb7-4e28-901f-e03defb0a76e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:04.952966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85c04542-9cb7-4e28-901f-e03defb0a76e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:04.953522 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85c04542-9cb7-4e28-901f-e03defb0a76e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:04.955192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85c04542-9cb7-4e28-901f-e03defb0a76e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:04.956020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85c04542-9cb7-4e28-901f-e03defb0a76e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:05.415035 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-85c04542-9cb7-4e28-901f-e03defb0a76e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:05.429368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-85c04542-9cb7-4e28-901f-e03defb0a76e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.494227 May 26 18:19:05.431891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 77/145] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:04 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:05.447978 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:19:05.449426 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:19:05.450168 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:19:05.450814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:19:05.451435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:19:05.466210 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:05.467019 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:05.468065 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:05.468732 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:05.494827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Getting quotas for project 84dc70884aff4a799bb8f38899766e81. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:19:05.503342 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Getting quotas for user 7f2ffbc59c60455cb9cadda081e30381 and project 84dc70884aff4a799bb8f38899766e81. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:19:05.535260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:19:05.541960 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:19:05.623236 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-438d30d4-11cf-4dab-8c6a-cad857311bcb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.101124 May 26 18:19:05.624729 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 69/146] 10.222.0.46 () {62 vars in 1187 bytes} [Thu May 26 18:19:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 18:19:05.634393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e408f1ba-93d2-467b-9dae-c2eb0a267577 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:05.635106 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e408f1ba-93d2-467b-9dae-c2eb0a267577 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:05.706028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e408f1ba-93d2-467b-9dae-c2eb0a267577 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:05.714953 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e408f1ba-93d2-467b-9dae-c2eb0a267577 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:05.716813 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e408f1ba-93d2-467b-9dae-c2eb0a267577 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:05.717749 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e408f1ba-93d2-467b-9dae-c2eb0a267577 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1281 microversion: 2.20 time: 0.087111 May 26 18:19:05.718749 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 78/147] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:05 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:19:06.447448 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9afd03ce-b3d5-475a-9c76-02ebbc65b4f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:06.448228 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9afd03ce-b3d5-475a-9c76-02ebbc65b4f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:06.457155 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9afd03ce-b3d5-475a-9c76-02ebbc65b4f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:06.457894 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9afd03ce-b3d5-475a-9c76-02ebbc65b4f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:06.458747 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9afd03ce-b3d5-475a-9c76-02ebbc65b4f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:06.459338 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9afd03ce-b3d5-475a-9c76-02ebbc65b4f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:06.620316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9afd03ce-b3d5-475a-9c76-02ebbc65b4f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:06.635686 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9afd03ce-b3d5-475a-9c76-02ebbc65b4f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.192181 May 26 18:19:06.637397 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 70/148] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:06 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:06.742442 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:06.743073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:06.749378 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:06.749879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:06.750660 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:06.751199 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:06.756470 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:06.821753 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:06.833521 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:06.835729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:06.837524 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-81a99766-d5db-436c-a23d-4cd3ae46beb0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1333 microversion: 2.20 time: 0.100776 May 26 18:19:06.838317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 79/149] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:06 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:19:07.655516 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-60f292c7-4a00-4b88-85ef-1c3828d0196f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:07.667289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-60f292c7-4a00-4b88-85ef-1c3828d0196f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:07.676785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-60f292c7-4a00-4b88-85ef-1c3828d0196f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:07.677236 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-60f292c7-4a00-4b88-85ef-1c3828d0196f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:07.680012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-60f292c7-4a00-4b88-85ef-1c3828d0196f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:07.680503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-60f292c7-4a00-4b88-85ef-1c3828d0196f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:07.857271 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:07.858734 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:07.867372 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:07.868365 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:07.869585 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:07.870083 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:07.924540 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-60f292c7-4a00-4b88-85ef-1c3828d0196f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:07.932600 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-60f292c7-4a00-4b88-85ef-1c3828d0196f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.281763 May 26 18:19:07.933463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 71/150] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:07 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:08.149795 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:08.161382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:08.163153 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:08.164273 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-859a63fc-aff9-4ad1-b9f7-f4c227e86dc8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.311748 May 26 18:19:08.164827 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 80/151] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:07 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:19:08.714879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-38ee4ea5-e691-46f6-b8f6-67ea384b4dc0 req-bc5d9b3a-cc65-4c7d-aa99-82a16720feb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0eeeed-f9b7-4526-bd2f-ac98a769fd80", "tag": "1d3fd217-af97-47a7-9225-e698208d450f"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:08.724672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:08.733876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-38ee4ea5-e691-46f6-b8f6-67ea384b4dc0 req-bc5d9b3a-cc65-4c7d-aa99-82a16720feb4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:08.734651 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-38ee4ea5-e691-46f6-b8f6-67ea384b4dc0 req-bc5d9b3a-cc65-4c7d-aa99-82a16720feb4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:08.760755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-38ee4ea5-e691-46f6-b8f6-67ea384b4dc0 req-bc5d9b3a-cc65-4c7d-aa99-82a16720feb4 service nova] Creating event network-changed:1d3fd217-af97-47a7-9225-e698208d450f for instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 on hv-cinder-84349 May 26 18:19:08.766602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-38ee4ea5-e691-46f6-b8f6-67ea384b4dc0 req-bc5d9b3a-cc65-4c7d-aa99-82a16720feb4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055072 May 26 18:19:08.771803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 72/152] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:08.951389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3df86907-e28d-47ef-a41c-8ecf801786f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:08.952794 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3df86907-e28d-47ef-a41c-8ecf801786f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:08.964919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3df86907-e28d-47ef-a41c-8ecf801786f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:08.965625 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3df86907-e28d-47ef-a41c-8ecf801786f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:08.968757 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3df86907-e28d-47ef-a41c-8ecf801786f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:08.969576 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3df86907-e28d-47ef-a41c-8ecf801786f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:09.184333 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:09.185050 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:09.200421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:09.201718 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:09.209676 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:09.210393 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:09.304065 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3df86907-e28d-47ef-a41c-8ecf801786f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:09.311401 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3df86907-e28d-47ef-a41c-8ecf801786f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.364217 May 26 18:19:09.311976 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 81/153] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:08 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:09.476018 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:09.490899 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:09.493062 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:09.496954 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-33d87ed7-72ff-406a-aef1-799524912d5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.316069 May 26 18:19:09.497893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 73/154] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:09 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:19:10.328500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b55c10ac-598d-4d2d-b4ae-ec81f4d77a88 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:10.329155 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b55c10ac-598d-4d2d-b4ae-ec81f4d77a88 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:10.340174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b55c10ac-598d-4d2d-b4ae-ec81f4d77a88 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:10.340174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b55c10ac-598d-4d2d-b4ae-ec81f4d77a88 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:10.340174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b55c10ac-598d-4d2d-b4ae-ec81f4d77a88 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:10.340174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b55c10ac-598d-4d2d-b4ae-ec81f4d77a88 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:10.478604 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b55c10ac-598d-4d2d-b4ae-ec81f4d77a88 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:10.487149 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b55c10ac-598d-4d2d-b4ae-ec81f4d77a88 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.162266 May 26 18:19:10.487814 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 82/155] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:10 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:10.517647 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:10.518350 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:10.525138 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:10.525595 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:10.526399 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:10.526831 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:10.709891 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:10.722680 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:10.724196 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:10.725317 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-640543c6-05d6-48f6-983b-77502a962f9d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.212046 May 26 18:19:10.725918 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 74/156] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:10 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:19:11.504467 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b45029b6-66c4-42cf-a90f-0d8c4f493de4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:11.505307 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b45029b6-66c4-42cf-a90f-0d8c4f493de4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:11.512682 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b45029b6-66c4-42cf-a90f-0d8c4f493de4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:11.513179 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b45029b6-66c4-42cf-a90f-0d8c4f493de4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:11.514233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b45029b6-66c4-42cf-a90f-0d8c4f493de4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:11.514698 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b45029b6-66c4-42cf-a90f-0d8c4f493de4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:11.714314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b45029b6-66c4-42cf-a90f-0d8c4f493de4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:11.723831 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b45029b6-66c4-42cf-a90f-0d8c4f493de4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.223901 May 26 18:19:11.724408 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 83/157] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:11 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:11.744655 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:11.745858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:11.755529 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:11.756000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:11.756789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:11.757231 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:11.901088 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:11.909860 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:11.911388 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:11.912486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-3a89fe63-1a48-44d5-b2ff-29c12bae3118 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.171924 May 26 18:19:11.913045 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 75/158] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:11 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:19:12.741046 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-76e22dce-c2a7-4e44-9e63-fc093dfe17b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:12.741687 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-76e22dce-c2a7-4e44-9e63-fc093dfe17b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:12.747676 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-76e22dce-c2a7-4e44-9e63-fc093dfe17b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:12.748123 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-76e22dce-c2a7-4e44-9e63-fc093dfe17b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:12.748913 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-76e22dce-c2a7-4e44-9e63-fc093dfe17b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:12.749344 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-76e22dce-c2a7-4e44-9e63-fc093dfe17b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:12.884687 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-76e22dce-c2a7-4e44-9e63-fc093dfe17b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:12.892770 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-76e22dce-c2a7-4e44-9e63-fc093dfe17b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.155545 May 26 18:19:12.893789 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 84/159] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:12 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:12.931500 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:12.931500 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:12.938071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:12.939041 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:12.939938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:12.940382 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:13.088242 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:13.097386 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:13.098937 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:13.100059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ec1aa1da-5c35-4937-bfa1-fecfc00bd42f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.172977 May 26 18:19:13.100632 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 76/160] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:12 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:19:13.912344 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9cdaab89-0184-427a-89b2-55a501d2eaf9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:13.912946 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9cdaab89-0184-427a-89b2-55a501d2eaf9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:13.919078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9cdaab89-0184-427a-89b2-55a501d2eaf9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:13.919534 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9cdaab89-0184-427a-89b2-55a501d2eaf9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:13.920374 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9cdaab89-0184-427a-89b2-55a501d2eaf9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:13.920883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9cdaab89-0184-427a-89b2-55a501d2eaf9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:14.065396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9cdaab89-0184-427a-89b2-55a501d2eaf9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:14.073275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9cdaab89-0184-427a-89b2-55a501d2eaf9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.165601 May 26 18:19:14.077502 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 85/161] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:13 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:14.117772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:14.118325 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:14.124702 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:14.125145 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:14.126291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:14.126738 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:14.267308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:14.282102 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:14.284876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:14.286582 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-820ca785-a4a5-4387-9eff-e7960b59fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.172537 May 26 18:19:14.287481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 77/162] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:14 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:19:15.098706 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-23964a88-e111-42b7-b986-c0bc2010bedc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:15.100140 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-23964a88-e111-42b7-b986-c0bc2010bedc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:15.113993 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23964a88-e111-42b7-b986-c0bc2010bedc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:15.114469 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23964a88-e111-42b7-b986-c0bc2010bedc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:15.117028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23964a88-e111-42b7-b986-c0bc2010bedc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:15.117480 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23964a88-e111-42b7-b986-c0bc2010bedc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:15.305012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:15.305635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:15.312535 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:15.313117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:15.316179 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:15.316643 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:15.351039 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-23964a88-e111-42b7-b986-c0bc2010bedc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:15.361598 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-23964a88-e111-42b7-b986-c0bc2010bedc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.269120 May 26 18:19:15.362829 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 86/163] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:15 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:15.482417 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:15.484816 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:15.494812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:15.497044 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:15.498412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2ad46c02-d300-4b9b-8a1e-88251e5f534a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.197464 May 26 18:19:15.499707 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 78/164] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:15 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:19:16.383021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f7a45b23-c876-4d18-9201-d1369413ae74 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:16.384037 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f7a45b23-c876-4d18-9201-d1369413ae74 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:16.391463 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:16.394469 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7a45b23-c876-4d18-9201-d1369413ae74 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:16.395013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7a45b23-c876-4d18-9201-d1369413ae74 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:16.395922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7a45b23-c876-4d18-9201-d1369413ae74 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:16.396420 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7a45b23-c876-4d18-9201-d1369413ae74 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:16.518976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:16.519576 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:16.521565 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=6 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:16.528251 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:16.528696 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:16.529454 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:16.529917 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:16.580609 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f7a45b23-c876-4d18-9201-d1369413ae74 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:16.588604 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f7a45b23-c876-4d18-9201-d1369413ae74 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.213146 May 26 18:19:16.589434 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 87/165] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:16 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:16.719152 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:16.733529 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:16.736682 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:16.738729 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9caca1f3-a3a5-49ca-8881-847a543708e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.224819 May 26 18:19:16.739471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 79/166] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:16 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:19:16.854662 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-849e5e6e-3448-44eb-9ce5-78a14db4f718 req-ca38e260-bfe8-4713-b28e-815262c22b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0eeeed-f9b7-4526-bd2f-ac98a769fd80", "name": "network-vif-plugged", "status": "completed", "tag": "1d3fd217-af97-47a7-9225-e698208d450f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:16.865017 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-849e5e6e-3448-44eb-9ce5-78a14db4f718 req-ca38e260-bfe8-4713-b28e-815262c22b88 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:16.866049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-849e5e6e-3448-44eb-9ce5-78a14db4f718 req-ca38e260-bfe8-4713-b28e-815262c22b88 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:16.902804 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-849e5e6e-3448-44eb-9ce5-78a14db4f718 req-ca38e260-bfe8-4713-b28e-815262c22b88 service nova] Creating event network-vif-plugged:1d3fd217-af97-47a7-9225-e698208d450f for instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 on hv-cinder-84349 May 26 18:19:16.914062 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-849e5e6e-3448-44eb-9ce5-78a14db4f718 req-ca38e260-bfe8-4713-b28e-815262c22b88 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063374 May 26 18:19:16.915008 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 88/167] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:19:17.609074 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-969df9c9-2ff8-49b2-8b58-fc8fd0b4fadd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:17.609787 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-969df9c9-2ff8-49b2-8b58-fc8fd0b4fadd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:17.618377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-969df9c9-2ff8-49b2-8b58-fc8fd0b4fadd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:17.619017 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-969df9c9-2ff8-49b2-8b58-fc8fd0b4fadd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:17.620044 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-969df9c9-2ff8-49b2-8b58-fc8fd0b4fadd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:17.620491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-969df9c9-2ff8-49b2-8b58-fc8fd0b4fadd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:17.758779 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:17.759642 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:17.767996 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:17.768496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:17.773695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:17.773695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:17.776589 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-969df9c9-2ff8-49b2-8b58-fc8fd0b4fadd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:17.790658 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-969df9c9-2ff8-49b2-8b58-fc8fd0b4fadd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.188227 May 26 18:19:17.800664 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 80/168] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:17 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:17.918299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:17.927892 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:17.929608 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:17.931369 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f7ca1494-7629-45a6-8914-3029bfe1dbdc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.178269 May 26 18:19:17.932115 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 89/169] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:17 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:19:18.807808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-949b73ee-139b-4a72-90de-7c3e5497c49e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:18.808443 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-949b73ee-139b-4a72-90de-7c3e5497c49e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:18.814970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-949b73ee-139b-4a72-90de-7c3e5497c49e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:18.815419 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-949b73ee-139b-4a72-90de-7c3e5497c49e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:18.816185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-949b73ee-139b-4a72-90de-7c3e5497c49e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:18.816625 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-949b73ee-139b-4a72-90de-7c3e5497c49e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:18.948322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:18.948778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-949b73ee-139b-4a72-90de-7c3e5497c49e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:18.948942 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:18.950945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=100 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:18.952176 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:18.956944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:18.957394 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:18.958196 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:18.958636 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:18.958763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-949b73ee-139b-4a72-90de-7c3e5497c49e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.154768 May 26 18:19:18.959341 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 81/170] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:18 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:19.131300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:19.139379 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:19.140888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:19.142717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-35f9455a-f647-4325-82ad-1b96e98ac68b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.198259 May 26 18:19:19.143582 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 90/171] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:18 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:19:19.975524 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7208267b-4fea-4e14-9be1-ffd8d0125cf0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:19.976126 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7208267b-4fea-4e14-9be1-ffd8d0125cf0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:19.982587 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7208267b-4fea-4e14-9be1-ffd8d0125cf0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:19.983038 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7208267b-4fea-4e14-9be1-ffd8d0125cf0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:19.983793 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7208267b-4fea-4e14-9be1-ffd8d0125cf0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:19.984267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7208267b-4fea-4e14-9be1-ffd8d0125cf0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:20.113870 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7208267b-4fea-4e14-9be1-ffd8d0125cf0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:20.121989 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7208267b-4fea-4e14-9be1-ffd8d0125cf0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.150627 May 26 18:19:20.122864 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 82/172] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:19 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:20.161025 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:20.161458 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:20.168856 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:20.169893 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:20.171260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:20.176255 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:20.353215 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:20.361949 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:20.364567 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:20.364692 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0e4eba89-5c37-4c19-afd9-79ddfed30359 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1407 microversion: 2.20 time: 0.208212 May 26 18:19:20.365196 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 91/173] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:20 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:19:21.142658 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-061d3ec6-fbe9-4b3d-a45e-8da7b8b7a6f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:21.143402 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-061d3ec6-fbe9-4b3d-a45e-8da7b8b7a6f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:21.153662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-061d3ec6-fbe9-4b3d-a45e-8da7b8b7a6f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:21.154166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-061d3ec6-fbe9-4b3d-a45e-8da7b8b7a6f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:21.154938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-061d3ec6-fbe9-4b3d-a45e-8da7b8b7a6f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:21.155372 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-061d3ec6-fbe9-4b3d-a45e-8da7b8b7a6f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:21.287370 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-061d3ec6-fbe9-4b3d-a45e-8da7b8b7a6f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:21.295699 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-061d3ec6-fbe9-4b3d-a45e-8da7b8b7a6f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.159380 May 26 18:19:21.296294 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 83/174] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:21 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:21.382926 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:21.383533 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:21.389571 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:21.390068 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:21.390901 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:21.391377 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:21.565750 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:21.574420 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:21.575946 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:21.577343 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e4d6c9ab-9ee5-4d40-98de-9ae1c8c15c77 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1599 microversion: 2.20 time: 0.198557 May 26 18:19:21.577922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 92/175] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:19:21 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1599 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:19:21.596242 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-dd198ee2-4057-4eb5-a850-e50142e46fa2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:21.596745 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-dd198ee2-4057-4eb5-a850-e50142e46fa2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:21.603542 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd198ee2-4057-4eb5-a850-e50142e46fa2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:21.604001 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd198ee2-4057-4eb5-a850-e50142e46fa2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:21.604779 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd198ee2-4057-4eb5-a850-e50142e46fa2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:21.605214 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd198ee2-4057-4eb5-a850-e50142e46fa2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:21.698934 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-dd198ee2-4057-4eb5-a850-e50142e46fa2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106969 May 26 18:19:21.699657 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 84/176] 10.222.0.46 () {60 vars in 1315 bytes} [Thu May 26 18:19:21 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:19:22.313939 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cfe08bae-4c39-491b-8da8-c610373e94e6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:22.314552 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cfe08bae-4c39-491b-8da8-c610373e94e6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:22.326531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cfe08bae-4c39-491b-8da8-c610373e94e6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:22.326987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cfe08bae-4c39-491b-8da8-c610373e94e6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:22.327755 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cfe08bae-4c39-491b-8da8-c610373e94e6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:22.328250 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cfe08bae-4c39-491b-8da8-c610373e94e6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:22.483021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cfe08bae-4c39-491b-8da8-c610373e94e6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:22.492108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cfe08bae-4c39-491b-8da8-c610373e94e6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.182141 May 26 18:19:22.493004 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 93/177] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:22 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:22.792946 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-822907ea-2aaf-4260-87a4-736782d333ad req-cff58dec-264c-4557-95f4-c6ac96be2d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0eeeed-f9b7-4526-bd2f-ac98a769fd80", "tag": "1d3fd217-af97-47a7-9225-e698208d450f"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:22.802166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-822907ea-2aaf-4260-87a4-736782d333ad req-cff58dec-264c-4557-95f4-c6ac96be2d52 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:22.802848 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-822907ea-2aaf-4260-87a4-736782d333ad req-cff58dec-264c-4557-95f4-c6ac96be2d52 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:22.821544 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-822907ea-2aaf-4260-87a4-736782d333ad req-cff58dec-264c-4557-95f4-c6ac96be2d52 service nova] Creating event network-changed:1d3fd217-af97-47a7-9225-e698208d450f for instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 on hv-cinder-84349 May 26 18:19:22.828353 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-822907ea-2aaf-4260-87a4-736782d333ad req-cff58dec-264c-4557-95f4-c6ac96be2d52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039147 May 26 18:19:22.829013 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 85/178] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:23.510725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-068f066b-3572-4d74-9da5-04a776eb1ce2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:23.511815 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-068f066b-3572-4d74-9da5-04a776eb1ce2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:23.519504 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-068f066b-3572-4d74-9da5-04a776eb1ce2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:23.519953 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-068f066b-3572-4d74-9da5-04a776eb1ce2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:23.520987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-068f066b-3572-4d74-9da5-04a776eb1ce2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:23.521420 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-068f066b-3572-4d74-9da5-04a776eb1ce2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:23.692084 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-068f066b-3572-4d74-9da5-04a776eb1ce2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:23.707507 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-068f066b-3572-4d74-9da5-04a776eb1ce2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.201067 May 26 18:19:23.716939 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 94/179] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:23 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:24.726691 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-670b3f0f-cc04-4b27-82fb-471ed33259f6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:24.727383 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-670b3f0f-cc04-4b27-82fb-471ed33259f6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:24.733590 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-670b3f0f-cc04-4b27-82fb-471ed33259f6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:24.734074 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-670b3f0f-cc04-4b27-82fb-471ed33259f6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:24.734942 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-670b3f0f-cc04-4b27-82fb-471ed33259f6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:24.735614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-670b3f0f-cc04-4b27-82fb-471ed33259f6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:24.887765 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-670b3f0f-cc04-4b27-82fb-471ed33259f6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:24.896237 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-670b3f0f-cc04-4b27-82fb-471ed33259f6 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.174508 May 26 18:19:24.896821 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 86/180] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:24 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:25.914224 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cb767e3b-36a6-461d-b1de-eba4ccc2269a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:25.914823 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cb767e3b-36a6-461d-b1de-eba4ccc2269a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:25.920803 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb767e3b-36a6-461d-b1de-eba4ccc2269a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:25.921251 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb767e3b-36a6-461d-b1de-eba4ccc2269a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:25.922293 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb767e3b-36a6-461d-b1de-eba4ccc2269a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:25.923454 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb767e3b-36a6-461d-b1de-eba4ccc2269a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:26.061549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cb767e3b-36a6-461d-b1de-eba4ccc2269a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:26.069713 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cb767e3b-36a6-461d-b1de-eba4ccc2269a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.159378 May 26 18:19:26.070287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 95/181] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:25 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:27.087460 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-26496dc5-03e4-479e-8c77-846f50a91ffc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:27.087975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-26496dc5-03e4-479e-8c77-846f50a91ffc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:27.096088 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-26496dc5-03e4-479e-8c77-846f50a91ffc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:27.096607 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-26496dc5-03e4-479e-8c77-846f50a91ffc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:27.097429 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-26496dc5-03e4-479e-8c77-846f50a91ffc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:27.097905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-26496dc5-03e4-479e-8c77-846f50a91ffc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:27.227772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-26496dc5-03e4-479e-8c77-846f50a91ffc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:27.235213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-26496dc5-03e4-479e-8c77-846f50a91ffc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.151855 May 26 18:19:27.235777 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 87/182] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:27 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:28.230215 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d9628e9d-f668-4fa6-b54e-0538a492a90d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:28.230748 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d9628e9d-f668-4fa6-b54e-0538a492a90d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:28.237704 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d9628e9d-f668-4fa6-b54e-0538a492a90d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:28.238178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d9628e9d-f668-4fa6-b54e-0538a492a90d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:28.238929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d9628e9d-f668-4fa6-b54e-0538a492a90d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:28.239356 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d9628e9d-f668-4fa6-b54e-0538a492a90d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:28.251786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-486920dc-52eb-41d3-a9c9-4ff53d99cae8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:28.252508 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-486920dc-52eb-41d3-a9c9-4ff53d99cae8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:28.256211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:28.259856 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-486920dc-52eb-41d3-a9c9-4ff53d99cae8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:28.260520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-486920dc-52eb-41d3-a9c9-4ff53d99cae8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:28.261560 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-486920dc-52eb-41d3-a9c9-4ff53d99cae8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:28.262220 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-486920dc-52eb-41d3-a9c9-4ff53d99cae8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:28.263618 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d9628e9d-f668-4fa6-b54e-0538a492a90d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/ips" status: 200 len: 149 microversion: 2.1 time: 0.037199 May 26 18:19:28.266397 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 96/183] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:19:28 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:28.401485 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-486920dc-52eb-41d3-a9c9-4ff53d99cae8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:28.410285 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-486920dc-52eb-41d3-a9c9-4ff53d99cae8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.162420 May 26 18:19:28.410869 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 88/184] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:28 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:29.428228 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e65d3648-3112-4d3d-abdb-4c790a5577f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:29.428829 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e65d3648-3112-4d3d-abdb-4c790a5577f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:29.435590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e65d3648-3112-4d3d-abdb-4c790a5577f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:29.436048 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e65d3648-3112-4d3d-abdb-4c790a5577f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:29.436813 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e65d3648-3112-4d3d-abdb-4c790a5577f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:29.437267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e65d3648-3112-4d3d-abdb-4c790a5577f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:29.570944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e65d3648-3112-4d3d-abdb-4c790a5577f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:29.579180 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e65d3648-3112-4d3d-abdb-4c790a5577f0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.154913 May 26 18:19:29.580122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 97/185] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:29 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:29.643372 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-fb28aa60-4f5f-4c08-befc-12ea77ca2603 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:29.644435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-fb28aa60-4f5f-4c08-befc-12ea77ca2603 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:29.650551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb28aa60-4f5f-4c08-befc-12ea77ca2603 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:29.651005 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb28aa60-4f5f-4c08-befc-12ea77ca2603 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:29.651767 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb28aa60-4f5f-4c08-befc-12ea77ca2603 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:29.652215 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb28aa60-4f5f-4c08-befc-12ea77ca2603 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:29.912730 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-fb28aa60-4f5f-4c08-befc-12ea77ca2603 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273893 May 26 18:19:29.913903 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 89/186] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:19:29 2022] POST /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:30.596630 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fc8ede02-3337-4a9a-9f48-6ff292c38e20 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:30.597240 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fc8ede02-3337-4a9a-9f48-6ff292c38e20 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:30.603532 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc8ede02-3337-4a9a-9f48-6ff292c38e20 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:30.604201 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc8ede02-3337-4a9a-9f48-6ff292c38e20 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:30.605313 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc8ede02-3337-4a9a-9f48-6ff292c38e20 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:30.605838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc8ede02-3337-4a9a-9f48-6ff292c38e20 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:30.752469 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fc8ede02-3337-4a9a-9f48-6ff292c38e20 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:30.760506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fc8ede02-3337-4a9a-9f48-6ff292c38e20 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1523 microversion: 2.1 time: 0.167720 May 26 18:19:30.761153 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 98/187] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:30 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:31.783026 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-caa713a4-c86e-41af-a5a5-538775e83199 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:31.783925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-caa713a4-c86e-41af-a5a5-538775e83199 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:31.794736 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-caa713a4-c86e-41af-a5a5-538775e83199 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:31.805297 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-caa713a4-c86e-41af-a5a5-538775e83199 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:31.805297 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-caa713a4-c86e-41af-a5a5-538775e83199 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:31.806188 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-caa713a4-c86e-41af-a5a5-538775e83199 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:31.980739 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-caa713a4-c86e-41af-a5a5-538775e83199 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:31.989445 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-caa713a4-c86e-41af-a5a5-538775e83199 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1503 microversion: 2.1 time: 0.215052 May 26 18:19:31.990098 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 90/188] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:31 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:32.008758 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-51acc05d-fa43-400b-b42d-112ff89f37a0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:32.009420 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-51acc05d-fa43-400b-b42d-112ff89f37a0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:32.016491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51acc05d-fa43-400b-b42d-112ff89f37a0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:32.017495 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51acc05d-fa43-400b-b42d-112ff89f37a0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:32.018683 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51acc05d-fa43-400b-b42d-112ff89f37a0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:32.019433 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51acc05d-fa43-400b-b42d-112ff89f37a0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:32.188544 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-51acc05d-fa43-400b-b42d-112ff89f37a0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:32.198579 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-51acc05d-fa43-400b-b42d-112ff89f37a0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1517 microversion: 2.1 time: 0.194680 May 26 18:19:32.199941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 99/189] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:32 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:33.646640 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d2b3ad02-49a1-4afb-afda-f7363c863c9a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:33.647963 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d2b3ad02-49a1-4afb-afda-f7363c863c9a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:33.654096 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2b3ad02-49a1-4afb-afda-f7363c863c9a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:33.654717 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2b3ad02-49a1-4afb-afda-f7363c863c9a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:33.655676 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2b3ad02-49a1-4afb-afda-f7363c863c9a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:33.656458 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2b3ad02-49a1-4afb-afda-f7363c863c9a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:33.686817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-d2b3ad02-49a1-4afb-afda-f7363c863c9a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lazy-loading 'flavor' on Instance uuid e56b5f3b-8d96-4c3a-92d3-8abd6feea703 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:19:33.775062 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d2b3ad02-49a1-4afb-afda-f7363c863c9a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703/action" status: 200 len: 32 microversion: 2.1 time: 0.123985 May 26 18:19:33.775062 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 91/190] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:19:33 2022] POST /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:19:33.777149 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-264717c8-f49f-4915-a4ac-2df82db60384 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:33.777932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-264717c8-f49f-4915-a4ac-2df82db60384 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:33.784880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-264717c8-f49f-4915-a4ac-2df82db60384 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:33.785421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-264717c8-f49f-4915-a4ac-2df82db60384 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:33.786233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-264717c8-f49f-4915-a4ac-2df82db60384 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:33.786675 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-264717c8-f49f-4915-a4ac-2df82db60384 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:34.045717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-264717c8-f49f-4915-a4ac-2df82db60384 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:34.057932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-264717c8-f49f-4915-a4ac-2df82db60384 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.284806 May 26 18:19:34.058608 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 100/191] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:33 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:35.077399 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-46784abf-f1be-4a34-b3f6-1332e0f08f8d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:35.078271 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-46784abf-f1be-4a34-b3f6-1332e0f08f8d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:35.086530 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46784abf-f1be-4a34-b3f6-1332e0f08f8d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:35.087385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46784abf-f1be-4a34-b3f6-1332e0f08f8d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:35.088186 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46784abf-f1be-4a34-b3f6-1332e0f08f8d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:35.088656 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46784abf-f1be-4a34-b3f6-1332e0f08f8d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:35.254378 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-46784abf-f1be-4a34-b3f6-1332e0f08f8d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:35.261789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-46784abf-f1be-4a34-b3f6-1332e0f08f8d tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.189257 May 26 18:19:35.262364 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 92/192] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:35 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:36.279156 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ac887c3-74e9-4ab6-887e-0c9a968ad9fb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:36.280482 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0ac887c3-74e9-4ab6-887e-0c9a968ad9fb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:36.287405 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ac887c3-74e9-4ab6-887e-0c9a968ad9fb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:36.288156 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ac887c3-74e9-4ab6-887e-0c9a968ad9fb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:36.289461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ac887c3-74e9-4ab6-887e-0c9a968ad9fb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:36.290108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ac887c3-74e9-4ab6-887e-0c9a968ad9fb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:36.439385 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ac887c3-74e9-4ab6-887e-0c9a968ad9fb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:36.450100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0ac887c3-74e9-4ab6-887e-0c9a968ad9fb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.174643 May 26 18:19:36.452573 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 101/193] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:36 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:37.494916 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-063a09b1-6be8-49ea-9228-905298463ee1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:37.495764 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-063a09b1-6be8-49ea-9228-905298463ee1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:37.509404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-063a09b1-6be8-49ea-9228-905298463ee1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:37.512204 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-063a09b1-6be8-49ea-9228-905298463ee1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:37.514227 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-063a09b1-6be8-49ea-9228-905298463ee1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:37.514672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-063a09b1-6be8-49ea-9228-905298463ee1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:37.578300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ca56ba4e-6451-4aea-b295-967ffbb39c5e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: .version_select at 0x7f5f188399d0>, body: {"keypair": {"name": "tempest-keypair-715014839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDY5SlJFgfdb+3SQsHCnB0ItZNEc9OQXFcdVoVsHPSjGI2RjEQ16zevQdcYyVQrAoH1es/G1LcZKn6QaNEm5Ma+GhJWRi2+i6fnrbiBPpzFZHRgIRDlwbDGGdFMyR6vgg=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:37.633588 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-ca56ba4e-6451-4aea-b295-967ffbb39c5e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:19:37.637994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-ca56ba4e-6451-4aea-b295-967ffbb39c5e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for user 8da0a5a09a6041d68c5e445af1a492f3 and project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:19:37.664848 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ca56ba4e-6451-4aea-b295-967ffbb39c5e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093032 May 26 18:19:37.665602 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 102/194] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:19:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:19:37.714239 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-063a09b1-6be8-49ea-9228-905298463ee1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:37.724147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-063a09b1-6be8-49ea-9228-905298463ee1 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.256576 May 26 18:19:37.725105 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 93/195] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:37 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:38.751140 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3a2085d6-aa51-4c03-9611-502d35aeba5e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:38.755121 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3a2085d6-aa51-4c03-9611-502d35aeba5e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:38.784845 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a2085d6-aa51-4c03-9611-502d35aeba5e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:38.785536 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a2085d6-aa51-4c03-9611-502d35aeba5e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:38.786595 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a2085d6-aa51-4c03-9611-502d35aeba5e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:38.788188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a2085d6-aa51-4c03-9611-502d35aeba5e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:39.225823 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3a2085d6-aa51-4c03-9611-502d35aeba5e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:39.233497 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3a2085d6-aa51-4c03-9611-502d35aeba5e tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.494866 May 26 18:19:39.246966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 103/196] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:38 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:40.255434 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e4db26e9-2f63-4b6f-9b5c-f03062d41e33 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:40.256656 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e4db26e9-2f63-4b6f-9b5c-f03062d41e33 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:40.259351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=44 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:40.264708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e4db26e9-2f63-4b6f-9b5c-f03062d41e33 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:40.265404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e4db26e9-2f63-4b6f-9b5c-f03062d41e33 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:40.266213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e4db26e9-2f63-4b6f-9b5c-f03062d41e33 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:40.267051 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e4db26e9-2f63-4b6f-9b5c-f03062d41e33 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:40.573577 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e4db26e9-2f63-4b6f-9b5c-f03062d41e33 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:40.583686 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e4db26e9-2f63-4b6f-9b5c-f03062d41e33 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.332743 May 26 18:19:40.584755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 94/197] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:40 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:40.919981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2065330856", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a9ad5fd-79c8-4cd5-b5bd-a36ef382cf69"}], "security_groups": [{"name": "tempest-securitygroup--1228260388"}], "key_name": "tempest-keypair-715014839", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:41.093661 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] validate_networks() for [('8a9ad5fd-79c8-4cd5-b5bd-a36ef382cf69', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:19:41.614803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ae86a94d-5956-47c6-b7e5-8dd63059f3b7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:41.616021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ae86a94d-5956-47c6-b7e5-8dd63059f3b7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:41.639615 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ae86a94d-5956-47c6-b7e5-8dd63059f3b7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:41.641381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ae86a94d-5956-47c6-b7e5-8dd63059f3b7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:41.645913 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ae86a94d-5956-47c6-b7e5-8dd63059f3b7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:41.648416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ae86a94d-5956-47c6-b7e5-8dd63059f3b7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:42.239982 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:19:42.240543 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:19:42.241344 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:19:42.241842 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:19:42.242448 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:19:42.257492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:42.258250 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:42.259222 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:42.259754 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:42.264112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ae86a94d-5956-47c6-b7e5-8dd63059f3b7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:42.284539 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ae86a94d-5956-47c6-b7e5-8dd63059f3b7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.679424 May 26 18:19:42.289575 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 95/198] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:41 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:42.300807 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:19:42.306089 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for user 8da0a5a09a6041d68c5e445af1a492f3 and project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:19:42.325980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:19:42.328456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:19:42.387832 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-137ba0f0-62ce-4b99-ac08-c4408cbc59b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.474182 May 26 18:19:42.389028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 104/199] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:19:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:19:42.399659 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e1ac99ec-3995-4dcd-90bf-8255fbbc08e1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:42.400387 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e1ac99ec-3995-4dcd-90bf-8255fbbc08e1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:42.511573 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e1ac99ec-3995-4dcd-90bf-8255fbbc08e1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:42.529679 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e1ac99ec-3995-4dcd-90bf-8255fbbc08e1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1241 microversion: 2.1 time: 0.133788 May 26 18:19:42.539998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 96/200] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:42 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:43.304794 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fb1cfeec-1d57-46ca-bebc-1d7c524fd029 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:43.306625 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fb1cfeec-1d57-46ca-bebc-1d7c524fd029 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:43.314848 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb1cfeec-1d57-46ca-bebc-1d7c524fd029 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:43.315595 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb1cfeec-1d57-46ca-bebc-1d7c524fd029 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:43.316850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb1cfeec-1d57-46ca-bebc-1d7c524fd029 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:43.317455 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb1cfeec-1d57-46ca-bebc-1d7c524fd029 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:43.548142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a4b181c8-3a52-4361-b436-f411004432a4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:43.549347 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a4b181c8-3a52-4361-b436-f411004432a4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:43.561913 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4b181c8-3a52-4361-b436-f411004432a4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:43.562369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4b181c8-3a52-4361-b436-f411004432a4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:43.563151 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4b181c8-3a52-4361-b436-f411004432a4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:43.564144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4b181c8-3a52-4361-b436-f411004432a4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:43.576920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:43.767091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a4b181c8-3a52-4361-b436-f411004432a4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:43.776174 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a4b181c8-3a52-4361-b436-f411004432a4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1293 microversion: 2.1 time: 0.232432 May 26 18:19:43.776781 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 97/201] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:43 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1293 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:43.827892 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fb1cfeec-1d57-46ca-bebc-1d7c524fd029 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:43.837866 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fb1cfeec-1d57-46ca-bebc-1d7c524fd029 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.537381 May 26 18:19:43.838491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 105/202] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:43 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:44.793553 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d2e6ef6d-910e-4a00-8ba2-15d5559b5ff4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:44.794435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d2e6ef6d-910e-4a00-8ba2-15d5559b5ff4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:44.805421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2e6ef6d-910e-4a00-8ba2-15d5559b5ff4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:44.805915 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2e6ef6d-910e-4a00-8ba2-15d5559b5ff4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:44.806703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2e6ef6d-910e-4a00-8ba2-15d5559b5ff4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:44.810626 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2e6ef6d-910e-4a00-8ba2-15d5559b5ff4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:44.855888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-00536672-8922-46f0-829e-fb78b94f1992 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:44.856501 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-00536672-8922-46f0-829e-fb78b94f1992 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:44.865939 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-00536672-8922-46f0-829e-fb78b94f1992 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:44.866405 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-00536672-8922-46f0-829e-fb78b94f1992 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:44.868420 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-00536672-8922-46f0-829e-fb78b94f1992 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:44.869507 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-00536672-8922-46f0-829e-fb78b94f1992 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:44.942999 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d2e6ef6d-910e-4a00-8ba2-15d5559b5ff4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:44.959989 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d2e6ef6d-910e-4a00-8ba2-15d5559b5ff4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1299 microversion: 2.1 time: 0.169980 May 26 18:19:44.960971 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 98/203] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:44 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:45.132704 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-00536672-8922-46f0-829e-fb78b94f1992 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:45.158165 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-00536672-8922-46f0-829e-fb78b94f1992 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.304658 May 26 18:19:45.161188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 106/204] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:44 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:45.978714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-35d92a43-67a0-437b-8bf1-16ea7c290451 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:45.980008 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-35d92a43-67a0-437b-8bf1-16ea7c290451 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:45.992980 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-35d92a43-67a0-437b-8bf1-16ea7c290451 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:45.995956 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-35d92a43-67a0-437b-8bf1-16ea7c290451 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:45.997621 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-35d92a43-67a0-437b-8bf1-16ea7c290451 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:45.998309 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-35d92a43-67a0-437b-8bf1-16ea7c290451 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:46.178177 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-56bdc93e-a889-45ce-8552-98276df375a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:46.178786 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-56bdc93e-a889-45ce-8552-98276df375a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:46.192000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56bdc93e-a889-45ce-8552-98276df375a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:46.192550 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56bdc93e-a889-45ce-8552-98276df375a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:46.193398 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56bdc93e-a889-45ce-8552-98276df375a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:46.194080 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56bdc93e-a889-45ce-8552-98276df375a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:46.768767 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-35d92a43-67a0-437b-8bf1-16ea7c290451 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:46.777381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-35d92a43-67a0-437b-8bf1-16ea7c290451 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.802575 May 26 18:19:46.778747 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 99/205] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:45 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:46.905248 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-56bdc93e-a889-45ce-8552-98276df375a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:46.926558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-56bdc93e-a889-45ce-8552-98276df375a5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.750916 May 26 18:19:46.929133 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 107/206] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:46 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:47.481506 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-ca136d5a-94f8-4f85-8672-cbe4ac851347 req-68b80a39-daac-4384-b70f-7c6fdfb5ffae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca22358-3d8a-4a3c-a5e9-cb003a11cf2c", "tag": "6d78a0b7-1afb-456a-9a08-dc8ea964b7b7"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:47.497576 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ca136d5a-94f8-4f85-8672-cbe4ac851347 req-68b80a39-daac-4384-b70f-7c6fdfb5ffae service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:47.498055 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ca136d5a-94f8-4f85-8672-cbe4ac851347 req-68b80a39-daac-4384-b70f-7c6fdfb5ffae service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:47.525199 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-ca136d5a-94f8-4f85-8672-cbe4ac851347 req-68b80a39-daac-4384-b70f-7c6fdfb5ffae service nova] Creating event network-changed:6d78a0b7-1afb-456a-9a08-dc8ea964b7b7 for instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c on hv-cinder-84349 May 26 18:19:47.535951 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-ca136d5a-94f8-4f85-8672-cbe4ac851347 req-68b80a39-daac-4384-b70f-7c6fdfb5ffae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058811 May 26 18:19:47.537046 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 100/207] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:19:47.801299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4f5013f8-12cf-4873-a491-2002aee20711 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:47.803985 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4f5013f8-12cf-4873-a491-2002aee20711 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:47.820778 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f5013f8-12cf-4873-a491-2002aee20711 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:47.825408 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f5013f8-12cf-4873-a491-2002aee20711 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:47.829888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f5013f8-12cf-4873-a491-2002aee20711 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:47.830540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f5013f8-12cf-4873-a491-2002aee20711 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:47.950135 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f2fe4553-c6c3-49fc-9940-cb2092b1bda4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:47.951145 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f2fe4553-c6c3-49fc-9940-cb2092b1bda4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:47.959531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f2fe4553-c6c3-49fc-9940-cb2092b1bda4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:47.960275 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f2fe4553-c6c3-49fc-9940-cb2092b1bda4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:47.961304 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f2fe4553-c6c3-49fc-9940-cb2092b1bda4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:47.962017 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f2fe4553-c6c3-49fc-9940-cb2092b1bda4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:48.159869 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4f5013f8-12cf-4873-a491-2002aee20711 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:48.171274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4f5013f8-12cf-4873-a491-2002aee20711 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.379644 May 26 18:19:48.172426 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 108/208] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:47 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:48.272415 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f2fe4553-c6c3-49fc-9940-cb2092b1bda4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:48.295533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f2fe4553-c6c3-49fc-9940-cb2092b1bda4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.353275 May 26 18:19:48.296490 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 101/209] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:47 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:49.190792 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4d239f97-1e91-43f8-8e3b-2148cb723623 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:49.191592 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4d239f97-1e91-43f8-8e3b-2148cb723623 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:49.193673 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:49.199430 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d239f97-1e91-43f8-8e3b-2148cb723623 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:49.199877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d239f97-1e91-43f8-8e3b-2148cb723623 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:49.200790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d239f97-1e91-43f8-8e3b-2148cb723623 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:49.208862 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d239f97-1e91-43f8-8e3b-2148cb723623 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:49.312542 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0aab3620-91b1-4449-b1c8-785098895c1f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:49.314722 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0aab3620-91b1-4449-b1c8-785098895c1f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:49.323842 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0aab3620-91b1-4449-b1c8-785098895c1f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:49.333079 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0aab3620-91b1-4449-b1c8-785098895c1f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:49.334240 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0aab3620-91b1-4449-b1c8-785098895c1f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:49.334824 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0aab3620-91b1-4449-b1c8-785098895c1f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:49.584178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4d239f97-1e91-43f8-8e3b-2148cb723623 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:49.594116 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4d239f97-1e91-43f8-8e3b-2148cb723623 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.406404 May 26 18:19:49.602253 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 109/210] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:49 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:49.697474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0aab3620-91b1-4449-b1c8-785098895c1f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:49.716121 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0aab3620-91b1-4449-b1c8-785098895c1f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.407336 May 26 18:19:49.743528 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 102/211] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:49 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:50.619286 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-93c7f0a4-c0d9-4f3b-b12d-02510b41619d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:50.621052 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-93c7f0a4-c0d9-4f3b-b12d-02510b41619d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:50.631914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93c7f0a4-c0d9-4f3b-b12d-02510b41619d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:50.632951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93c7f0a4-c0d9-4f3b-b12d-02510b41619d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:50.634220 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93c7f0a4-c0d9-4f3b-b12d-02510b41619d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:50.634869 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93c7f0a4-c0d9-4f3b-b12d-02510b41619d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:50.742246 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7144a730-2cf4-4457-b1d4-f8a971d2e819 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:50.746144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7144a730-2cf4-4457-b1d4-f8a971d2e819 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:50.766965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7144a730-2cf4-4457-b1d4-f8a971d2e819 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:50.775737 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7144a730-2cf4-4457-b1d4-f8a971d2e819 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:50.779066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7144a730-2cf4-4457-b1d4-f8a971d2e819 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:50.781287 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7144a730-2cf4-4457-b1d4-f8a971d2e819 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:50.902300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-93c7f0a4-c0d9-4f3b-b12d-02510b41619d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:50.911966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-93c7f0a4-c0d9-4f3b-b12d-02510b41619d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.296655 May 26 18:19:50.921799 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 110/212] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:50 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:50.927959 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-96312626-00aa-409a-a0dd-c1acb4e485c4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:50.928671 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-96312626-00aa-409a-a0dd-c1acb4e485c4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:50.934729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-96312626-00aa-409a-a0dd-c1acb4e485c4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:50.935378 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-96312626-00aa-409a-a0dd-c1acb4e485c4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:50.936488 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-96312626-00aa-409a-a0dd-c1acb4e485c4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:50.937076 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-96312626-00aa-409a-a0dd-c1acb4e485c4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:50.964349 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-96312626-00aa-409a-a0dd-c1acb4e485c4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/ips" status: 200 len: 145 microversion: 2.1 time: 0.040103 May 26 18:19:50.965497 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 111/213] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:19:50 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:50.992555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7144a730-2cf4-4457-b1d4-f8a971d2e819 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:51.008423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7144a730-2cf4-4457-b1d4-f8a971d2e819 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.271288 May 26 18:19:51.008423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 103/214] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:50 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:51.928750 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-50dd852d-7abe-485c-b789-ae642c487a6d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:51.929371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-50dd852d-7abe-485c-b789-ae642c487a6d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:51.944755 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50dd852d-7abe-485c-b789-ae642c487a6d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:51.946179 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50dd852d-7abe-485c-b789-ae642c487a6d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:51.947382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50dd852d-7abe-485c-b789-ae642c487a6d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:51.949599 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50dd852d-7abe-485c-b789-ae642c487a6d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:52.024153 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9e4ae8fb-a80d-4f57-a44c-7d41684c06e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:52.024856 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9e4ae8fb-a80d-4f57-a44c-7d41684c06e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:52.062711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e4ae8fb-a80d-4f57-a44c-7d41684c06e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:52.063856 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e4ae8fb-a80d-4f57-a44c-7d41684c06e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:52.064483 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e4ae8fb-a80d-4f57-a44c-7d41684c06e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:52.064970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e4ae8fb-a80d-4f57-a44c-7d41684c06e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:52.179822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-50dd852d-7abe-485c-b789-ae642c487a6d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:52.197864 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-50dd852d-7abe-485c-b789-ae642c487a6d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.272723 May 26 18:19:52.198580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 112/215] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:51 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:52.261891 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9e4ae8fb-a80d-4f57-a44c-7d41684c06e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:52.284869 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9e4ae8fb-a80d-4f57-a44c-7d41684c06e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.264352 May 26 18:19:52.295504 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 104/216] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:52 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:53.231729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-660a5f1f-8ef9-49bc-95bd-749144958fdd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:53.234468 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-660a5f1f-8ef9-49bc-95bd-749144958fdd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:53.242689 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:53.247421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=10 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:53.269897 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-660a5f1f-8ef9-49bc-95bd-749144958fdd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:53.274369 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-660a5f1f-8ef9-49bc-95bd-749144958fdd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:53.275523 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-660a5f1f-8ef9-49bc-95bd-749144958fdd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:53.277296 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-660a5f1f-8ef9-49bc-95bd-749144958fdd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:53.304789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-334c082c-6d44-4959-b06a-723c44e3836a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:53.306116 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-334c082c-6d44-4959-b06a-723c44e3836a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:53.308622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:53.332395 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-334c082c-6d44-4959-b06a-723c44e3836a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:53.333111 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-334c082c-6d44-4959-b06a-723c44e3836a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:53.334004 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-334c082c-6d44-4959-b06a-723c44e3836a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:53.347228 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-334c082c-6d44-4959-b06a-723c44e3836a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:53.641430 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-334c082c-6d44-4959-b06a-723c44e3836a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:53.646951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-660a5f1f-8ef9-49bc-95bd-749144958fdd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:53.654498 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-660a5f1f-8ef9-49bc-95bd-749144958fdd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.439010 May 26 18:19:53.664646 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 113/217] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:53 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:53.669856 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-334c082c-6d44-4959-b06a-723c44e3836a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.370845 May 26 18:19:53.671701 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 105/218] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:53 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:53.770608 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2b5c80cf-1ee7-48a9-a378-227325effc5d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "200db120-9af5-4c08-8bff-99e7e7db232c"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:53.772009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2b5c80cf-1ee7-48a9-a378-227325effc5d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:53.791886 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b5c80cf-1ee7-48a9-a378-227325effc5d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:53.792343 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b5c80cf-1ee7-48a9-a378-227325effc5d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:53.793128 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b5c80cf-1ee7-48a9-a378-227325effc5d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:53.793565 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b5c80cf-1ee7-48a9-a378-227325effc5d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:54.678555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c750ed5b-ecb4-4460-bb0a-aa76329023bb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:54.680710 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c750ed5b-ecb4-4460-bb0a-aa76329023bb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:54.692526 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c750ed5b-ecb4-4460-bb0a-aa76329023bb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:54.692972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c750ed5b-ecb4-4460-bb0a-aa76329023bb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:54.720981 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c750ed5b-ecb4-4460-bb0a-aa76329023bb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:54.721365 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c750ed5b-ecb4-4460-bb0a-aa76329023bb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:54.987583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:55.050520 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2b5c80cf-1ee7-48a9-a378-227325effc5d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.284465 May 26 18:19:55.052373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 114/219] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:19:53 2022] POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/os-volume_attachments => generated 194 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:55.062675 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7987911d-c64d-4d53-8829-4a926d75edeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:55.064895 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7987911d-c64d-4d53-8829-4a926d75edeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:55.082659 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7987911d-c64d-4d53-8829-4a926d75edeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.083644 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7987911d-c64d-4d53-8829-4a926d75edeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.084645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7987911d-c64d-4d53-8829-4a926d75edeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.086340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7987911d-c64d-4d53-8829-4a926d75edeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.098962 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c750ed5b-ecb4-4460-bb0a-aa76329023bb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:55.107862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c750ed5b-ecb4-4460-bb0a-aa76329023bb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.437129 May 26 18:19:55.114238 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 106/220] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:54 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:55.403922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7987911d-c64d-4d53-8829-4a926d75edeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:55.413375 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7987911d-c64d-4d53-8829-4a926d75edeb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1503 microversion: 2.1 time: 0.359595 May 26 18:19:55.426432 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 115/221] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:55 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1503 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:55.431175 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d01aa95c-2100-4c06-b755-ffb15692d4bc"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:55.432827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:55.439870 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.440427 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.441474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.441955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.468338 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] HTTP exception thrown: Cannot 'attach_volume' instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 while it is in vm_state rescued May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Request method failure captured: May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: POST /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703/os-volume_attachments HTTP/1.1 May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 74 May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RWODLYi3wdaspll1zSy4mFYh46s3GN57iRM-L_-oq2PC7kcMeh3vdvzheNADnGzneVMfEKJQD3fIE7UbLMCCJH1QIAx7okekyzdCgqUMi23a9gOm7NEbdM2gUEcXOy9FAQIbx6XMUkM4IF8RynHZWEW4I9HmMmXTcFriT68BGeYPA May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:19:55.471224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5cb09766b9784d50aad144d466a5d050", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 3b3f8de4a3b54d58806506b827cfa89a May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {"volumeAttachment": {"volumeId": "d01aa95c-2100-4c06-b755-ffb15692d4bc"}} May 26 18:19:55.472509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Cannot 'attach_volume' instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 while it is in vm_state rescued May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'server_id': 'e56b5f3b-8d96-4c3a-92d3-8abd6feea703', 'body': {'volumeAttachment': {'volumeId': 'd01aa95c-2100-4c06-b755-ffb15692d4bc'}}} May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:19:55.473340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 while it is in vm_state rescued May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:19:55.474531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:19:55.475618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:19:55.475618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:19:55.475618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 while it is in vm_state rescued May 26 18:19:55.475618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:19:55.477381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Returning 409 to user: Cannot 'attach_volume' instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 while it is in vm_state rescued {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:19:55.478528 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-867173e4-7f73-4dda-b83c-b2e60e383e05 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051438 May 26 18:19:55.479694 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 107/222] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:19:55 2022] POST /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 18:19:55.489580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-25bb40a3-ffae-42a7-b33e-26f2d9385082 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:55.490436 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-25bb40a3-ffae-42a7-b33e-26f2d9385082 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:55.497522 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-25bb40a3-ffae-42a7-b33e-26f2d9385082 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.498269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-25bb40a3-ffae-42a7-b33e-26f2d9385082 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.499416 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-25bb40a3-ffae-42a7-b33e-26f2d9385082 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.500078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-25bb40a3-ffae-42a7-b33e-26f2d9385082 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.624558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-25bb40a3-ffae-42a7-b33e-26f2d9385082 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703/action" status: 202 len: 0 microversion: 2.1 time: 0.139228 May 26 18:19:55.634977 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f481434b-5137-453f-8d1e-f80d123742bb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:55.635717 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f481434b-5137-453f-8d1e-f80d123742bb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:55.637130 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 116/223] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:19:55 2022] POST /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:19:55.655802 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f481434b-5137-453f-8d1e-f80d123742bb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.656464 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f481434b-5137-453f-8d1e-f80d123742bb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.657531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f481434b-5137-453f-8d1e-f80d123742bb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.658408 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f481434b-5137-453f-8d1e-f80d123742bb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.952137 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f481434b-5137-453f-8d1e-f80d123742bb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:55.966673 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f481434b-5137-453f-8d1e-f80d123742bb tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1511 microversion: 2.1 time: 0.335904 May 26 18:19:55.967966 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 108/224] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:55 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:56.129673 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-03216fbd-2a5b-4373-8e6d-f689fc4db392 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:56.131370 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-03216fbd-2a5b-4373-8e6d-f689fc4db392 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:56.140108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-03216fbd-2a5b-4373-8e6d-f689fc4db392 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:56.140819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-03216fbd-2a5b-4373-8e6d-f689fc4db392 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:56.142496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-03216fbd-2a5b-4373-8e6d-f689fc4db392 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:56.143249 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-03216fbd-2a5b-4373-8e6d-f689fc4db392 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:56.513352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-03216fbd-2a5b-4373-8e6d-f689fc4db392 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:56.528472 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-03216fbd-2a5b-4373-8e6d-f689fc4db392 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.403530 May 26 18:19:56.532558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 117/225] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:56 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:56.851569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-a079579e-2d87-46d8-990e-ee9dfbf90504 req-87d71456-abca-48c3-b8e2-f81b44641f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca22358-3d8a-4a3c-a5e9-cb003a11cf2c", "name": "network-vif-plugged", "status": "completed", "tag": "6d78a0b7-1afb-456a-9a08-dc8ea964b7b7"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:56.881124 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a079579e-2d87-46d8-990e-ee9dfbf90504 req-87d71456-abca-48c3-b8e2-f81b44641f6b service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:56.881678 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a079579e-2d87-46d8-990e-ee9dfbf90504 req-87d71456-abca-48c3-b8e2-f81b44641f6b service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:56.919889 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-a079579e-2d87-46d8-990e-ee9dfbf90504 req-87d71456-abca-48c3-b8e2-f81b44641f6b service nova] Creating event network-vif-plugged:6d78a0b7-1afb-456a-9a08-dc8ea964b7b7 for instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c on hv-cinder-84349 May 26 18:19:56.928650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-a079579e-2d87-46d8-990e-ee9dfbf90504 req-87d71456-abca-48c3-b8e2-f81b44641f6b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087167 May 26 18:19:56.930288 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 109/226] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:56.998645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-51ece7f6-f779-4112-afed-f09c584adfc5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:56.999274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-51ece7f6-f779-4112-afed-f09c584adfc5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:57.017465 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51ece7f6-f779-4112-afed-f09c584adfc5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:57.018009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51ece7f6-f779-4112-afed-f09c584adfc5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:57.018775 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51ece7f6-f779-4112-afed-f09c584adfc5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:57.019218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51ece7f6-f779-4112-afed-f09c584adfc5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:57.254741 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-51ece7f6-f779-4112-afed-f09c584adfc5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:57.264415 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-51ece7f6-f779-4112-afed-f09c584adfc5 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1511 microversion: 2.1 time: 0.280013 May 26 18:19:57.265006 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 118/227] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:56 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:57.550408 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8477ddda-74e2-455c-bdcb-3a3cde07a1e2 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:57.551271 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8477ddda-74e2-455c-bdcb-3a3cde07a1e2 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:57.558669 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8477ddda-74e2-455c-bdcb-3a3cde07a1e2 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:57.564080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8477ddda-74e2-455c-bdcb-3a3cde07a1e2 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:57.565282 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8477ddda-74e2-455c-bdcb-3a3cde07a1e2 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:57.569751 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8477ddda-74e2-455c-bdcb-3a3cde07a1e2 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:57.743937 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8477ddda-74e2-455c-bdcb-3a3cde07a1e2 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:57.754154 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8477ddda-74e2-455c-bdcb-3a3cde07a1e2 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.208928 May 26 18:19:57.764530 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 110/228] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:57 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:58.286080 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f6434a8b-e2f5-4bca-bada-4e637d029790 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:58.287337 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f6434a8b-e2f5-4bca-bada-4e637d029790 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:58.304217 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f6434a8b-e2f5-4bca-bada-4e637d029790 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:58.305159 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f6434a8b-e2f5-4bca-bada-4e637d029790 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:58.306228 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f6434a8b-e2f5-4bca-bada-4e637d029790 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:58.308705 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f6434a8b-e2f5-4bca-bada-4e637d029790 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:58.612759 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f6434a8b-e2f5-4bca-bada-4e637d029790 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:58.623285 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f6434a8b-e2f5-4bca-bada-4e637d029790 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1511 microversion: 2.1 time: 0.344422 May 26 18:19:58.623865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 119/229] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:58 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:58.771855 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-681ab2db-cad1-457b-a2ba-31c47cedb4d3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:58.772697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-681ab2db-cad1-457b-a2ba-31c47cedb4d3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:58.785871 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-681ab2db-cad1-457b-a2ba-31c47cedb4d3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:58.786338 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-681ab2db-cad1-457b-a2ba-31c47cedb4d3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:58.787301 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-681ab2db-cad1-457b-a2ba-31c47cedb4d3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:58.787899 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-681ab2db-cad1-457b-a2ba-31c47cedb4d3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:58.966660 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-681ab2db-cad1-457b-a2ba-31c47cedb4d3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:58.988844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-681ab2db-cad1-457b-a2ba-31c47cedb4d3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.220694 May 26 18:19:58.998371 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 111/230] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:58 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:59.639492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1077245178", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:59.641113 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1fabd40f-2163-4d6b-ad59-45fcc7bde44f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:59.641768 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1fabd40f-2163-4d6b-ad59-45fcc7bde44f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:59.649680 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1fabd40f-2163-4d6b-ad59-45fcc7bde44f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:59.650236 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1fabd40f-2163-4d6b-ad59-45fcc7bde44f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:59.651208 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1fabd40f-2163-4d6b-ad59-45fcc7bde44f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:59.651803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1fabd40f-2163-4d6b-ad59-45fcc7bde44f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:59.702542 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] validate_networks() for None {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:20:00.051576 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1fabd40f-2163-4d6b-ad59-45fcc7bde44f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:00.059447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1fabd40f-2163-4d6b-ad59-45fcc7bde44f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1517 microversion: 2.1 time: 0.422084 May 26 18:20:00.075023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 112/231] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:19:59 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1517 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:00.078551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3b9fea8f-f6ef-4d62-a0e6-65a87eee4eeb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:00.079420 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-3b9fea8f-f6ef-4d62-a0e6-65a87eee4eeb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:00.086593 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3b9fea8f-f6ef-4d62-a0e6-65a87eee4eeb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:00.087086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3b9fea8f-f6ef-4d62-a0e6-65a87eee4eeb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:00.087946 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3b9fea8f-f6ef-4d62-a0e6-65a87eee4eeb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:00.088472 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3b9fea8f-f6ef-4d62-a0e6-65a87eee4eeb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:00.124064 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:20:00.124823 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:20:00.129617 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:20:00.134498 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:20:00.139667 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:20:00.168125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:00.169766 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:00.170793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:00.171237 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:00.192276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Getting quotas for project 73e8074335b04d60987b4f8b1371a9bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:20:00.196622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Getting quotas for user ba793692ba62427a86d52880f1f659a8 and project 73e8074335b04d60987b4f8b1371a9bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:20:00.226085 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:20:00.228372 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:20:00.272367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3b9fea8f-f6ef-4d62-a0e6-65a87eee4eeb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:00.287743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-81b37751-4d50-4e61-ab0a-e995b27c7b1c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651978 May 26 18:20:00.287990 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-3b9fea8f-f6ef-4d62-a0e6-65a87eee4eeb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1367 microversion: 2.1 time: 0.213393 May 26 18:20:00.288815 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 113/232] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:00 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:00.289406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 120/233] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:19:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:20:00.300844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2b6d2aef-999c-4995-a352-01fec6494185 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:00.305692 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2b6d2aef-999c-4995-a352-01fec6494185 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:00.409012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2b6d2aef-999c-4995-a352-01fec6494185 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:00.419052 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2b6d2aef-999c-4995-a352-01fec6494185 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1215 microversion: 2.1 time: 0.122812 May 26 18:20:00.431176 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 114/234] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:00 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:01.304854 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-09eea8d5-0d89-4fed-9494-3e048bd583b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:01.305411 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-09eea8d5-0d89-4fed-9494-3e048bd583b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:01.312703 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09eea8d5-0d89-4fed-9494-3e048bd583b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:01.313157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09eea8d5-0d89-4fed-9494-3e048bd583b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:01.313979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09eea8d5-0d89-4fed-9494-3e048bd583b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:01.314414 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09eea8d5-0d89-4fed-9494-3e048bd583b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:01.437328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4252e88d-526a-4e12-bfb4-c7f113ff5652 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:01.439385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4252e88d-526a-4e12-bfb4-c7f113ff5652 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:01.448451 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4252e88d-526a-4e12-bfb4-c7f113ff5652 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:01.449224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4252e88d-526a-4e12-bfb4-c7f113ff5652 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:01.450832 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4252e88d-526a-4e12-bfb4-c7f113ff5652 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:01.451644 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4252e88d-526a-4e12-bfb4-c7f113ff5652 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:01.471511 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-09eea8d5-0d89-4fed-9494-3e048bd583b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:01.483920 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-09eea8d5-0d89-4fed-9494-3e048bd583b1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1558 microversion: 2.1 time: 0.181103 May 26 18:20:01.484643 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 121/235] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:01 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:01.503371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-493563fb-a931-4a95-8ed0-6854330068fd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:01.503902 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-493563fb-a931-4a95-8ed0-6854330068fd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:01.515897 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-493563fb-a931-4a95-8ed0-6854330068fd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:01.518501 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-493563fb-a931-4a95-8ed0-6854330068fd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:01.520504 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-493563fb-a931-4a95-8ed0-6854330068fd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:01.521143 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-493563fb-a931-4a95-8ed0-6854330068fd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:01.561307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4252e88d-526a-4e12-bfb4-c7f113ff5652 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:01.572925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4252e88d-526a-4e12-bfb4-c7f113ff5652 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1219 microversion: 2.1 time: 0.139169 May 26 18:20:01.573826 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 115/236] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:01 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:01.579557 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-84f429e6-c0c1-49a0-98d7-65d245c06553 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'create', calling method: .version_select at 0x7f5f1b19bca0>, body: {"keypair": {"name": "tempest-keypair-643309950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKn5WAzMIPAf1FbardmFhFVRC42LUWZ/2u7WplIdsxHAsIiy0KqLXBpqncMJaN+QVFEIzxb7cXmwqAUJctpsU5Y1kQN4juDQ+LgzPjD+1HyCnCF39gF6F26biP56kOZHA=="}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:01.595699 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-84f429e6-c0c1-49a0-98d7-65d245c06553 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Getting quotas for project 5cb09766b9784d50aad144d466a5d050. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:20:01.600614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-84f429e6-c0c1-49a0-98d7-65d245c06553 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Getting quotas for user 3b3f8de4a3b54d58806506b827cfa89a and project 5cb09766b9784d50aad144d466a5d050. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:20:01.629518 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-493563fb-a931-4a95-8ed0-6854330068fd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132890 May 26 18:20:01.630707 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 122/237] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 18:20:01 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:01.640469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-84f429e6-c0c1-49a0-98d7-65d245c06553 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064947 May 26 18:20:01.641334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 116/238] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:20:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:02.591893 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b0719bd0-f0e7-42ac-891f-8ccfa920f811 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:02.592503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b0719bd0-f0e7-42ac-891f-8ccfa920f811 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:02.604954 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b0719bd0-f0e7-42ac-891f-8ccfa920f811 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:02.606238 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b0719bd0-f0e7-42ac-891f-8ccfa920f811 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:02.607203 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b0719bd0-f0e7-42ac-891f-8ccfa920f811 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:02.608663 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b0719bd0-f0e7-42ac-891f-8ccfa920f811 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:02.958711 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b0719bd0-f0e7-42ac-891f-8ccfa920f811 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:02.967020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b0719bd0-f0e7-42ac-891f-8ccfa920f811 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1219 microversion: 2.1 time: 0.379694 May 26 18:20:02.967975 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 123/239] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:02 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1219 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:03.170465 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-ea5848e1-b228-4d28-9774-c08c59346dc0 req-d8b05cdd-8dce-475b-866d-535be7fab0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca22358-3d8a-4a3c-a5e9-cb003a11cf2c", "tag": "6d78a0b7-1afb-456a-9a08-dc8ea964b7b7"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:03.182924 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ea5848e1-b228-4d28-9774-c08c59346dc0 req-d8b05cdd-8dce-475b-866d-535be7fab0f3 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:03.183621 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ea5848e1-b228-4d28-9774-c08c59346dc0 req-d8b05cdd-8dce-475b-866d-535be7fab0f3 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:03.199974 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-ea5848e1-b228-4d28-9774-c08c59346dc0 req-d8b05cdd-8dce-475b-866d-535be7fab0f3 service nova] Creating event network-changed:6d78a0b7-1afb-456a-9a08-dc8ea964b7b7 for instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c on hv-cinder-84349 May 26 18:20:03.207263 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-ea5848e1-b228-4d28-9774-c08c59346dc0 req-d8b05cdd-8dce-475b-866d-535be7fab0f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040530 May 26 18:20:03.208540 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 117/240] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:03.498710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-206133893", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c1d13cb-66bd-44a0-a8a3-bdb9797fb0f4"}], "security_groups": [{"name": "tempest-securitygroup--1838657399"}], "key_name": "tempest-keypair-643309950", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:03.618370 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] validate_networks() for [('0c1d13cb-66bd-44a0-a8a3-bdb9797fb0f4', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:20:03.999899 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c19a2124-b180-448a-b9ad-1f02e8998ab7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:04.006955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c19a2124-b180-448a-b9ad-1f02e8998ab7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:04.021461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c19a2124-b180-448a-b9ad-1f02e8998ab7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.022350 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c19a2124-b180-448a-b9ad-1f02e8998ab7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.023404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c19a2124-b180-448a-b9ad-1f02e8998ab7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.024136 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c19a2124-b180-448a-b9ad-1f02e8998ab7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.047851 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=100 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:04.111213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c19a2124-b180-448a-b9ad-1f02e8998ab7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:04.114027 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:20:04.114456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:20:04.114931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:20:04.115342 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:20:04.116041 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:20:04.121825 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c19a2124-b180-448a-b9ad-1f02e8998ab7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1219 microversion: 2.1 time: 0.139528 May 26 18:20:04.122415 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 118/241] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:03 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:04.127713 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.128076 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.129086 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.129559 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.149684 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Getting quotas for project 5cb09766b9784d50aad144d466a5d050. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:20:04.153954 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Getting quotas for user 3b3f8de4a3b54d58806506b827cfa89a and project 5cb09766b9784d50aad144d466a5d050. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:20:04.166392 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:20:04.168539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:20:04.195626 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-10329477-2e0a-4d9f-8d23-8cb3924ab492 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Action: 'create', calling method: .version_select at 0x7f5f18e800d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-714646482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE8oO+lqHnzF06SoA9eAJakMdVA1eYQDzWKqSGs59pSkmATJSdDS6zMY6lISwJD06h4wWcYilIipAJsBfBahZomG7ZT/pp0Z/zrCYzds8914A8GUHCDFgRUuE3yxOcDyw=="}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:04.212142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-10329477-2e0a-4d9f-8d23-8cb3924ab492 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Getting quotas for project d08521617c884fe9a67609887f0ddaae. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:20:04.216696 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-10329477-2e0a-4d9f-8d23-8cb3924ab492 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Getting quotas for user 5462b6a8d72749b9a07cd52ff8cb29d1 and project d08521617c884fe9a67609887f0ddaae. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:20:04.228091 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a1767cc4-6802-46fb-a65a-519452ecaecf tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.734028 May 26 18:20:04.228809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 124/242] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:20:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:20:04.239763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d97c014b-ceb0-4087-8f49-4eb2b95208b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:04.240374 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d97c014b-ceb0-4087-8f49-4eb2b95208b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:04.245523 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-10329477-2e0a-4d9f-8d23-8cb3924ab492 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053914 May 26 18:20:04.246183 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 119/243] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:20:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:20:04.318247 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d97c014b-ceb0-4087-8f49-4eb2b95208b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:04.327634 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d97c014b-ceb0-4087-8f49-4eb2b95208b0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1244 microversion: 2.1 time: 0.092461 May 26 18:20:04.329062 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 125/244] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:04 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:04.388751 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1264357611", "imageRef": "d932e0e6-0344-4b63-a43e-75a47969f875", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-714646482", "networks": [{"uuid": "89ba9544-9a06-4842-a8d3-5ca2550e14ac"}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:04.444676 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] validate_networks() for [('89ba9544-9a06-4842-a8d3-5ca2550e14ac', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:20:04.824594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:20:04.825009 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:20:04.825504 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:20:04.825945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:20:04.826377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:20:04.836208 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.836646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.837431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.837896 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.854187 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Getting quotas for project d08521617c884fe9a67609887f0ddaae. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:20:04.858056 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Getting quotas for user 5462b6a8d72749b9a07cd52ff8cb29d1 and project d08521617c884fe9a67609887f0ddaae. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:20:04.868901 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:20:04.871087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d932e0e6-0344-4b63-a43e-75a47969f875',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:20:04.919212 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7d80d760-3692-48aa-9cbe-07ba9dbf424f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534177 May 26 18:20:04.919870 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 120/245] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:20:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:20:04.931220 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1fe071ea-eef4-436c-a7d5-5ea9c0156016 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:04.931220 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1fe071ea-eef4-436c-a7d5-5ea9c0156016 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:04.991407 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1fe071ea-eef4-436c-a7d5-5ea9c0156016 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:05.001838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1fe071ea-eef4-436c-a7d5-5ea9c0156016 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1258 microversion: 2.1 time: 0.075323 May 26 18:20:05.002635 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 126/246] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:04 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:05.139938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-83973021-fe9e-4cb9-9c76-fa29398c547e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:05.140566 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-83973021-fe9e-4cb9-9c76-fa29398c547e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:05.148921 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-83973021-fe9e-4cb9-9c76-fa29398c547e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:05.149557 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-83973021-fe9e-4cb9-9c76-fa29398c547e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:05.150367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-83973021-fe9e-4cb9-9c76-fa29398c547e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:05.150813 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-83973021-fe9e-4cb9-9c76-fa29398c547e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:05.214501 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-83973021-fe9e-4cb9-9c76-fa29398c547e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:05.223407 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-83973021-fe9e-4cb9-9c76-fa29398c547e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1219 microversion: 2.1 time: 0.087342 May 26 18:20:05.224174 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 121/247] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:05 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:05.345245 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4aa90ffc-c8d7-4d3d-936b-1ab4034d6659 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:05.346044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4aa90ffc-c8d7-4d3d-936b-1ab4034d6659 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:05.352826 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4aa90ffc-c8d7-4d3d-936b-1ab4034d6659 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:05.353331 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4aa90ffc-c8d7-4d3d-936b-1ab4034d6659 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:05.354134 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4aa90ffc-c8d7-4d3d-936b-1ab4034d6659 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:05.354566 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4aa90ffc-c8d7-4d3d-936b-1ab4034d6659 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:05.414490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4aa90ffc-c8d7-4d3d-936b-1ab4034d6659 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:05.421802 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4aa90ffc-c8d7-4d3d-936b-1ab4034d6659 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1248 microversion: 2.1 time: 0.081105 May 26 18:20:05.422792 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 127/248] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:05 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:06.020067 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-db828c5e-4788-4d10-b968-24c9ab16fc1e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:06.020750 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-db828c5e-4788-4d10-b968-24c9ab16fc1e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:06.027095 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-db828c5e-4788-4d10-b968-24c9ab16fc1e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:06.027779 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-db828c5e-4788-4d10-b968-24c9ab16fc1e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:06.028749 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-db828c5e-4788-4d10-b968-24c9ab16fc1e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:06.029378 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-db828c5e-4788-4d10-b968-24c9ab16fc1e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:06.122034 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-db828c5e-4788-4d10-b968-24c9ab16fc1e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:06.130049 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-db828c5e-4788-4d10-b968-24c9ab16fc1e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1262 microversion: 2.1 time: 0.115094 May 26 18:20:06.130624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 122/249] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:06 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1262 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:06.239956 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2cbdc60b-3117-4c0c-b93e-01ecdbe1b321 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:06.240563 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2cbdc60b-3117-4c0c-b93e-01ecdbe1b321 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:06.247125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2cbdc60b-3117-4c0c-b93e-01ecdbe1b321 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:06.247575 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2cbdc60b-3117-4c0c-b93e-01ecdbe1b321 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:06.248340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2cbdc60b-3117-4c0c-b93e-01ecdbe1b321 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:06.248773 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2cbdc60b-3117-4c0c-b93e-01ecdbe1b321 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:06.311210 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2cbdc60b-3117-4c0c-b93e-01ecdbe1b321 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:06.319207 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2cbdc60b-3117-4c0c-b93e-01ecdbe1b321 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1219 microversion: 2.1 time: 0.083612 May 26 18:20:06.320005 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 128/250] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:06 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:06.439312 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7ee71ede-fc01-4204-8534-9caeab059731 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:06.439934 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7ee71ede-fc01-4204-8534-9caeab059731 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:06.450693 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7ee71ede-fc01-4204-8534-9caeab059731 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:06.451509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7ee71ede-fc01-4204-8534-9caeab059731 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:06.452566 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7ee71ede-fc01-4204-8534-9caeab059731 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:06.453212 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7ee71ede-fc01-4204-8534-9caeab059731 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:06.528621 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7ee71ede-fc01-4204-8534-9caeab059731 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:06.537074 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7ee71ede-fc01-4204-8534-9caeab059731 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1248 microversion: 2.1 time: 0.101804 May 26 18:20:06.537805 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 123/251] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:06 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1248 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:07.147479 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a6a85166-fa88-47e7-a77d-c1d20fe66caf tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:07.148091 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a6a85166-fa88-47e7-a77d-c1d20fe66caf tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:07.154481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6a85166-fa88-47e7-a77d-c1d20fe66caf tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.154935 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6a85166-fa88-47e7-a77d-c1d20fe66caf tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.155747 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6a85166-fa88-47e7-a77d-c1d20fe66caf tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.156182 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6a85166-fa88-47e7-a77d-c1d20fe66caf tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.202772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bb5877dd-9901-4028-ae1b-0388ae92cd98 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:07.205421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:07.210912 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bb5877dd-9901-4028-ae1b-0388ae92cd98 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.211369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bb5877dd-9901-4028-ae1b-0388ae92cd98 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.218759 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a6a85166-fa88-47e7-a77d-c1d20fe66caf tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:07.226319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a6a85166-fa88-47e7-a77d-c1d20fe66caf tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1310 microversion: 2.1 time: 0.082810 May 26 18:20:07.226882 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 129/252] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:07 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:07.279953 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-bb5877dd-9901-4028-ae1b-0388ae92cd98 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Going to try to stop instance {{(pid=117697) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 18:20:07.336898 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bad3ab4a-39dd-4c10-b144-1fa3868f732e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:07.337599 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bad3ab4a-39dd-4c10-b144-1fa3868f732e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:07.345195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bad3ab4a-39dd-4c10-b144-1fa3868f732e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.345675 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bad3ab4a-39dd-4c10-b144-1fa3868f732e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.346528 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bad3ab4a-39dd-4c10-b144-1fa3868f732e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.347226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bad3ab4a-39dd-4c10-b144-1fa3868f732e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.348003 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-bb5877dd-9901-4028-ae1b-0388ae92cd98 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/action" status: 202 len: 0 microversion: 2.1 time: 0.149019 May 26 18:20:07.348828 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 124/253] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:20:07 2022] POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:20:07.359107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1d8fe1f8-4c0e-47dc-9f2f-b1386f413484 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:07.360485 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1d8fe1f8-4c0e-47dc-9f2f-b1386f413484 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:07.368046 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1d8fe1f8-4c0e-47dc-9f2f-b1386f413484 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.368525 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1d8fe1f8-4c0e-47dc-9f2f-b1386f413484 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.369307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1d8fe1f8-4c0e-47dc-9f2f-b1386f413484 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.369839 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1d8fe1f8-4c0e-47dc-9f2f-b1386f413484 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.418135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bad3ab4a-39dd-4c10-b144-1fa3868f732e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:07.426116 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bad3ab4a-39dd-4c10-b144-1fa3868f732e tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1267 microversion: 2.1 time: 0.093496 May 26 18:20:07.426928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 130/254] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:07 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:07.512973 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1d8fe1f8-4c0e-47dc-9f2f-b1386f413484 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:07.521572 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1d8fe1f8-4c0e-47dc-9f2f-b1386f413484 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.168729 May 26 18:20:07.522187 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 125/255] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:07 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:07.554389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-17c65976-9c39-4078-a4a8-c37c63ee33b8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:07.555162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-17c65976-9c39-4078-a4a8-c37c63ee33b8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:07.561168 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-17c65976-9c39-4078-a4a8-c37c63ee33b8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.561615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-17c65976-9c39-4078-a4a8-c37c63ee33b8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.562413 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-17c65976-9c39-4078-a4a8-c37c63ee33b8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.562869 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-17c65976-9c39-4078-a4a8-c37c63ee33b8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.644624 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-17c65976-9c39-4078-a4a8-c37c63ee33b8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:07.653686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-17c65976-9c39-4078-a4a8-c37c63ee33b8 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1296 microversion: 2.1 time: 0.103147 May 26 18:20:07.654521 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 131/256] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:07 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:08.246267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-551dbe0b-4d8a-46f3-ba3a-f47d87a4c3fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:08.247202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-551dbe0b-4d8a-46f3-ba3a-f47d87a4c3fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:08.261647 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-551dbe0b-4d8a-46f3-ba3a-f47d87a4c3fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.262673 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-551dbe0b-4d8a-46f3-ba3a-f47d87a4c3fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.263495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-551dbe0b-4d8a-46f3-ba3a-f47d87a4c3fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.263941 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-551dbe0b-4d8a-46f3-ba3a-f47d87a4c3fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.354838 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-551dbe0b-4d8a-46f3-ba3a-f47d87a4c3fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:08.363477 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-551dbe0b-4d8a-46f3-ba3a-f47d87a4c3fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1316 microversion: 2.1 time: 0.122850 May 26 18:20:08.364289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 126/257] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:08 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:08.443279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2d0969d7-7bc0-42ab-812d-a24b544ee1a8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:08.443894 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2d0969d7-7bc0-42ab-812d-a24b544ee1a8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:08.453034 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d0969d7-7bc0-42ab-812d-a24b544ee1a8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.453942 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d0969d7-7bc0-42ab-812d-a24b544ee1a8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.454934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d0969d7-7bc0-42ab-812d-a24b544ee1a8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.455579 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d0969d7-7bc0-42ab-812d-a24b544ee1a8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.540226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a9d377e5-dd7e-4cca-bb81-85b792ee852e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:08.543030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a9d377e5-dd7e-4cca-bb81-85b792ee852e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:08.553383 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a9d377e5-dd7e-4cca-bb81-85b792ee852e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.554322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a9d377e5-dd7e-4cca-bb81-85b792ee852e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.555709 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a9d377e5-dd7e-4cca-bb81-85b792ee852e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.557150 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a9d377e5-dd7e-4cca-bb81-85b792ee852e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.557980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2d0969d7-7bc0-42ab-812d-a24b544ee1a8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:08.571750 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2d0969d7-7bc0-42ab-812d-a24b544ee1a8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1273 microversion: 2.1 time: 0.131628 May 26 18:20:08.572395 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 132/258] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:08 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:08.672058 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e889f3a1-77dd-4bd6-9e45-0cedc6ad967f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:08.673888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e889f3a1-77dd-4bd6-9e45-0cedc6ad967f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:08.682066 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e889f3a1-77dd-4bd6-9e45-0cedc6ad967f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.682791 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e889f3a1-77dd-4bd6-9e45-0cedc6ad967f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.683773 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e889f3a1-77dd-4bd6-9e45-0cedc6ad967f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.684332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e889f3a1-77dd-4bd6-9e45-0cedc6ad967f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.708403 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:08.806945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e889f3a1-77dd-4bd6-9e45-0cedc6ad967f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:08.822567 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e889f3a1-77dd-4bd6-9e45-0cedc6ad967f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1302 microversion: 2.1 time: 0.154787 May 26 18:20:08.823474 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 133/259] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:08 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1302 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:08.966785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a9d377e5-dd7e-4cca-bb81-85b792ee852e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:08.994487 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a9d377e5-dd7e-4cca-bb81-85b792ee852e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.458278 May 26 18:20:08.998372 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 127/260] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:08 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:09.381365 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-60e630da-c41a-4f71-aa3b-735337c9ffaa tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:09.382337 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-60e630da-c41a-4f71-aa3b-735337c9ffaa tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:09.395437 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60e630da-c41a-4f71-aa3b-735337c9ffaa tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:09.395971 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60e630da-c41a-4f71-aa3b-735337c9ffaa tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:09.396822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60e630da-c41a-4f71-aa3b-735337c9ffaa tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:09.397323 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60e630da-c41a-4f71-aa3b-735337c9ffaa tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:09.576267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-60e630da-c41a-4f71-aa3b-735337c9ffaa tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:09.588342 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-60e630da-c41a-4f71-aa3b-735337c9ffaa tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1316 microversion: 2.1 time: 0.211032 May 26 18:20:09.588609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b9660455-a547-427c-ad96-15dd93370454 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:09.589226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b9660455-a547-427c-ad96-15dd93370454 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:09.590623 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 134/261] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:09 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:09.602356 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b9660455-a547-427c-ad96-15dd93370454 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:09.603404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b9660455-a547-427c-ad96-15dd93370454 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:09.604788 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b9660455-a547-427c-ad96-15dd93370454 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:09.605629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b9660455-a547-427c-ad96-15dd93370454 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:09.716462 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b9660455-a547-427c-ad96-15dd93370454 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:09.731000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b9660455-a547-427c-ad96-15dd93370454 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1273 microversion: 2.1 time: 0.142872 May 26 18:20:09.733316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 128/262] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:09 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:09.739851 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ed264f15-a8dc-42c4-9834-7ac81cfea9ea tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:09.740545 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ed264f15-a8dc-42c4-9834-7ac81cfea9ea tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:09.749803 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ed264f15-a8dc-42c4-9834-7ac81cfea9ea tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:09.751509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ed264f15-a8dc-42c4-9834-7ac81cfea9ea tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:09.754525 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ed264f15-a8dc-42c4-9834-7ac81cfea9ea tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:09.754983 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ed264f15-a8dc-42c4-9834-7ac81cfea9ea tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:09.793835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ed264f15-a8dc-42c4-9834-7ac81cfea9ea tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/ips" status: 200 len: 152 microversion: 2.20 time: 0.057082 May 26 18:20:09.795300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 135/263] 10.222.0.46 () {60 vars in 1288 bytes} [Thu May 26 18:20:09 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/ips => generated 152 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:20:09.845988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d2602b99-4137-4c28-81d2-9f3c8e25eafe tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:09.846607 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d2602b99-4137-4c28-81d2-9f3c8e25eafe tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:09.853454 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2602b99-4137-4c28-81d2-9f3c8e25eafe tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:09.853941 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2602b99-4137-4c28-81d2-9f3c8e25eafe tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:09.854796 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2602b99-4137-4c28-81d2-9f3c8e25eafe tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:09.855294 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d2602b99-4137-4c28-81d2-9f3c8e25eafe tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:10.019473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e8567b39-9860-49d7-80cd-eba014361e4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:10.020463 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e8567b39-9860-49d7-80cd-eba014361e4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:10.027515 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8567b39-9860-49d7-80cd-eba014361e4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:10.028203 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8567b39-9860-49d7-80cd-eba014361e4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:10.029125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8567b39-9860-49d7-80cd-eba014361e4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:10.029704 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e8567b39-9860-49d7-80cd-eba014361e4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:10.556083 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d2602b99-4137-4c28-81d2-9f3c8e25eafe tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:10.567692 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d2602b99-4137-4c28-81d2-9f3c8e25eafe tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.728291 May 26 18:20:10.580087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 129/264] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:09 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:10.611267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7e03148e-a15e-422b-99ae-d5e3a9be4283 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:10.615905 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e8567b39-9860-49d7-80cd-eba014361e4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:10.624068 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7e03148e-a15e-422b-99ae-d5e3a9be4283 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:10.631139 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e8567b39-9860-49d7-80cd-eba014361e4d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.616622 May 26 18:20:10.634082 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 136/265] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:10 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:10.647254 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7e03148e-a15e-422b-99ae-d5e3a9be4283 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:10.648019 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7e03148e-a15e-422b-99ae-d5e3a9be4283 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:10.649177 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7e03148e-a15e-422b-99ae-d5e3a9be4283 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:10.652841 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7e03148e-a15e-422b-99ae-d5e3a9be4283 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:10.751362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-68910d31-e6a2-48a4-96a4-e64f38d828b8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:10.752942 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-68910d31-e6a2-48a4-96a4-e64f38d828b8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:10.767982 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-68910d31-e6a2-48a4-96a4-e64f38d828b8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:10.768484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-68910d31-e6a2-48a4-96a4-e64f38d828b8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:10.769279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-68910d31-e6a2-48a4-96a4-e64f38d828b8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:10.769710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-68910d31-e6a2-48a4-96a4-e64f38d828b8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:10.900235 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7e03148e-a15e-422b-99ae-d5e3a9be4283 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:10.912604 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7e03148e-a15e-422b-99ae-d5e3a9be4283 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.307506 May 26 18:20:10.914081 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 130/266] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:10 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:10.947793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-68910d31-e6a2-48a4-96a4-e64f38d828b8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:10.956481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-68910d31-e6a2-48a4-96a4-e64f38d828b8 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.209768 May 26 18:20:10.957071 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 137/267] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:10 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:11.586633 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-41791889-23c4-4f60-94b0-e8e0523ba44b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:11.587153 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-41791889-23c4-4f60-94b0-e8e0523ba44b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:11.600130 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-41791889-23c4-4f60-94b0-e8e0523ba44b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:11.600694 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-41791889-23c4-4f60-94b0-e8e0523ba44b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:11.601480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-41791889-23c4-4f60-94b0-e8e0523ba44b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:11.601957 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-41791889-23c4-4f60-94b0-e8e0523ba44b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:11.649654 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c7929d5a-2d1e-4df0-883c-5051d6882e6d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:11.650403 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c7929d5a-2d1e-4df0-883c-5051d6882e6d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:11.657463 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c7929d5a-2d1e-4df0-883c-5051d6882e6d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:11.658028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c7929d5a-2d1e-4df0-883c-5051d6882e6d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:11.659000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c7929d5a-2d1e-4df0-883c-5051d6882e6d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:11.659433 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c7929d5a-2d1e-4df0-883c-5051d6882e6d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:11.803419 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-41791889-23c4-4f60-94b0-e8e0523ba44b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:11.817053 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-41791889-23c4-4f60-94b0-e8e0523ba44b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.234277 May 26 18:20:11.818568 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 131/268] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:11 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:11.851930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c7929d5a-2d1e-4df0-883c-5051d6882e6d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:11.862582 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c7929d5a-2d1e-4df0-883c-5051d6882e6d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.215695 May 26 18:20:11.869089 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 138/269] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:11 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:11.931106 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-278bcb54-bbcd-413e-8d66-d278a3804dac tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:11.931716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-278bcb54-bbcd-413e-8d66-d278a3804dac tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:11.938502 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-278bcb54-bbcd-413e-8d66-d278a3804dac tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:11.938950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-278bcb54-bbcd-413e-8d66-d278a3804dac tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:11.939717 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-278bcb54-bbcd-413e-8d66-d278a3804dac tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:11.940152 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-278bcb54-bbcd-413e-8d66-d278a3804dac tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:11.972852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a6aa653b-0407-4f93-ada9-21467874eaa7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:11.973456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a6aa653b-0407-4f93-ada9-21467874eaa7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:11.979935 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6aa653b-0407-4f93-ada9-21467874eaa7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:11.980642 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6aa653b-0407-4f93-ada9-21467874eaa7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:11.981582 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6aa653b-0407-4f93-ada9-21467874eaa7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:11.982035 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6aa653b-0407-4f93-ada9-21467874eaa7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:12.132538 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-278bcb54-bbcd-413e-8d66-d278a3804dac tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:12.140001 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-278bcb54-bbcd-413e-8d66-d278a3804dac tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.212875 May 26 18:20:12.140584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 132/270] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:11 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:12.155456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a6aa653b-0407-4f93-ada9-21467874eaa7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:12.166430 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a6aa653b-0407-4f93-ada9-21467874eaa7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.197187 May 26 18:20:12.167793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 139/271] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:11 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:12.835011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-71b744ed-fd49-4cf0-b7db-52c754f03722 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:12.835609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-71b744ed-fd49-4cf0-b7db-52c754f03722 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:12.842099 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-71b744ed-fd49-4cf0-b7db-52c754f03722 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:12.842556 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-71b744ed-fd49-4cf0-b7db-52c754f03722 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:12.843313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-71b744ed-fd49-4cf0-b7db-52c754f03722 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:12.843748 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-71b744ed-fd49-4cf0-b7db-52c754f03722 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:12.866462 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-34fb7945-378e-40af-b116-509d67258195 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:12.867033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-34fb7945-378e-40af-b116-509d67258195 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:12.873416 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-34fb7945-378e-40af-b116-509d67258195 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:12.873918 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-34fb7945-378e-40af-b116-509d67258195 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:12.874681 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-34fb7945-378e-40af-b116-509d67258195 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:12.875125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-34fb7945-378e-40af-b116-509d67258195 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:12.900623 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-34fb7945-378e-40af-b116-509d67258195 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lazy-loading 'flavor' on Instance uuid aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:20:12.992442 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-71b744ed-fd49-4cf0-b7db-52c754f03722 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:13.001112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-71b744ed-fd49-4cf0-b7db-52c754f03722 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.169194 May 26 18:20:13.001944 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 133/272] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:12 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:13.007132 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-df968e2e-c967-4c2f-b769-e219511dbde7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:13.007744 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-df968e2e-c967-4c2f-b769-e219511dbde7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:13.014496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-df968e2e-c967-4c2f-b769-e219511dbde7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:13.014976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-df968e2e-c967-4c2f-b769-e219511dbde7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:13.016203 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-df968e2e-c967-4c2f-b769-e219511dbde7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:13.016795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-df968e2e-c967-4c2f-b769-e219511dbde7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:13.185079 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-df968e2e-c967-4c2f-b769-e219511dbde7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:13.198680 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-df968e2e-c967-4c2f-b769-e219511dbde7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.195520 May 26 18:20:13.199541 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 134/273] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:13 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:13.214893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a9335ba3-ebab-494d-a10c-d178b3e99456 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:13.215756 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a9335ba3-ebab-494d-a10c-d178b3e99456 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:13.223186 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a9335ba3-ebab-494d-a10c-d178b3e99456 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:13.223780 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a9335ba3-ebab-494d-a10c-d178b3e99456 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:13.224670 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a9335ba3-ebab-494d-a10c-d178b3e99456 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:13.225228 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a9335ba3-ebab-494d-a10c-d178b3e99456 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:13.239110 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-34fb7945-378e-40af-b116-509d67258195 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/action" status: 202 len: 0 microversion: 2.20 time: 0.376265 May 26 18:20:13.242983 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:13.248500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 140/274] 10.222.0.46 () {62 vars in 1318 bytes} [Thu May 26 18:20:12 2022] POST /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:20:13.255169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-04d605eb-e115-4275-bff3-096a56c63ccd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:13.256103 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-04d605eb-e115-4275-bff3-096a56c63ccd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:13.264734 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04d605eb-e115-4275-bff3-096a56c63ccd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:13.265188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04d605eb-e115-4275-bff3-096a56c63ccd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:13.266656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04d605eb-e115-4275-bff3-096a56c63ccd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:13.267184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-04d605eb-e115-4275-bff3-096a56c63ccd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:13.470496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-04d605eb-e115-4275-bff3-096a56c63ccd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:13.475150 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a9335ba3-ebab-494d-a10c-d178b3e99456 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:13.480047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-04d605eb-e115-4275-bff3-096a56c63ccd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.229997 May 26 18:20:13.490393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 141/275] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:13 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:13.490393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:13.490393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:13.490393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:13.496695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:13.497876 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:13.499298 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a9335ba3-ebab-494d-a10c-d178b3e99456 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.287266 May 26 18:20:13.499431 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:13.499972 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:13.501745 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 135/276] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:13 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:13.666629 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:13.676108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:13.677630 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:13.678848 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0c0de465-b66f-4792-9a20-8669b64cbb67 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.197326 May 26 18:20:13.679398 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 142/277] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:13 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:14.019436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a7b2a1e3-2cdf-4c6d-b719-c851ff3fd7c2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:14.020125 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a7b2a1e3-2cdf-4c6d-b719-c851ff3fd7c2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:14.027389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7b2a1e3-2cdf-4c6d-b719-c851ff3fd7c2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.027879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7b2a1e3-2cdf-4c6d-b719-c851ff3fd7c2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.028718 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7b2a1e3-2cdf-4c6d-b719-c851ff3fd7c2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.029146 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7b2a1e3-2cdf-4c6d-b719-c851ff3fd7c2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.183585 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a7b2a1e3-2cdf-4c6d-b719-c851ff3fd7c2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:14.191922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a7b2a1e3-2cdf-4c6d-b719-c851ff3fd7c2 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.177157 May 26 18:20:14.192497 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 136/278] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:14 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:14.216131 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e7247c58-1b63-46d4-957d-ab415aeaaebf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:14.216737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e7247c58-1b63-46d4-957d-ab415aeaaebf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:14.219070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:14.224671 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e7247c58-1b63-46d4-957d-ab415aeaaebf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.225120 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e7247c58-1b63-46d4-957d-ab415aeaaebf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.225915 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e7247c58-1b63-46d4-957d-ab415aeaaebf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.226352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e7247c58-1b63-46d4-957d-ab415aeaaebf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.379250 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e7247c58-1b63-46d4-957d-ab415aeaaebf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:14.387255 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e7247c58-1b63-46d4-957d-ab415aeaaebf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.174906 May 26 18:20:14.387817 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 143/279] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:14 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:14.498225 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f6ad1f69-1eff-4735-b6cd-5f3d1f1c18f7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:14.499147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f6ad1f69-1eff-4735-b6cd-5f3d1f1c18f7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:14.506202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f6ad1f69-1eff-4735-b6cd-5f3d1f1c18f7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.506645 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f6ad1f69-1eff-4735-b6cd-5f3d1f1c18f7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.507475 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f6ad1f69-1eff-4735-b6cd-5f3d1f1c18f7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.507905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f6ad1f69-1eff-4735-b6cd-5f3d1f1c18f7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.520245 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b96dd5db-bce9-4672-bff8-5d83cb20b243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:14.521144 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b96dd5db-bce9-4672-bff8-5d83cb20b243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:14.532101 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b96dd5db-bce9-4672-bff8-5d83cb20b243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.532705 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b96dd5db-bce9-4672-bff8-5d83cb20b243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.533588 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b96dd5db-bce9-4672-bff8-5d83cb20b243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.534181 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b96dd5db-bce9-4672-bff8-5d83cb20b243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.708285 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f6ad1f69-1eff-4735-b6cd-5f3d1f1c18f7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:14.716684 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f6ad1f69-1eff-4735-b6cd-5f3d1f1c18f7 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.222227 May 26 18:20:14.717628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 137/280] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:14 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:14.723197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:14.724015 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:14.730267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.730720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.731123 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b96dd5db-bce9-4672-bff8-5d83cb20b243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:14.731561 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:14.732029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:14.739293 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b96dd5db-bce9-4672-bff8-5d83cb20b243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.224013 May 26 18:20:14.739867 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 144/281] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:14 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:14.845375 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:14.864453 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:14.866611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=16 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:14.873764 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:14.875355 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:14.876518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6f470934-ce5f-40ee-b8c7-6dad72df2b6e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.158031 May 26 18:20:14.877077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 138/282] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:14 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:15.210292 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-37ad8b75-e4c8-4573-bd8a-6b0f267d0860 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:15.210906 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-37ad8b75-e4c8-4573-bd8a-6b0f267d0860 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:15.214124 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=16 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:15.218389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-37ad8b75-e4c8-4573-bd8a-6b0f267d0860 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.219062 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-37ad8b75-e4c8-4573-bd8a-6b0f267d0860 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.219769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-37ad8b75-e4c8-4573-bd8a-6b0f267d0860 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.220202 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-37ad8b75-e4c8-4573-bd8a-6b0f267d0860 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.364623 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-37ad8b75-e4c8-4573-bd8a-6b0f267d0860 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:15.374822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-37ad8b75-e4c8-4573-bd8a-6b0f267d0860 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.169198 May 26 18:20:15.377499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 145/283] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:15 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:15.404784 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-fd540f9b-34f7-4984-b16f-366951cdfa48 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:15.405662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-fd540f9b-34f7-4984-b16f-366951cdfa48 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:15.413541 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fd540f9b-34f7-4984-b16f-366951cdfa48 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.414265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fd540f9b-34f7-4984-b16f-366951cdfa48 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.415209 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fd540f9b-34f7-4984-b16f-366951cdfa48 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.416020 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fd540f9b-34f7-4984-b16f-366951cdfa48 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.562183 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-fd540f9b-34f7-4984-b16f-366951cdfa48 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:15.572791 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-fd540f9b-34f7-4984-b16f-366951cdfa48 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.171693 May 26 18:20:15.574064 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 139/284] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:15 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:15.733699 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c2cc38f1-c1ac-487b-ab95-c6113f791ef0 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:15.734363 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c2cc38f1-c1ac-487b-ab95-c6113f791ef0 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:15.741321 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2cc38f1-c1ac-487b-ab95-c6113f791ef0 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.741807 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2cc38f1-c1ac-487b-ab95-c6113f791ef0 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.742570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2cc38f1-c1ac-487b-ab95-c6113f791ef0 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.743007 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2cc38f1-c1ac-487b-ab95-c6113f791ef0 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.756865 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e5422a83-c47e-479a-bd89-9f7cf42378ce tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:15.757395 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e5422a83-c47e-479a-bd89-9f7cf42378ce tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:15.763268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e5422a83-c47e-479a-bd89-9f7cf42378ce tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.763711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e5422a83-c47e-479a-bd89-9f7cf42378ce tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.764458 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e5422a83-c47e-479a-bd89-9f7cf42378ce tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.764889 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e5422a83-c47e-479a-bd89-9f7cf42378ce tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.950389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c2cc38f1-c1ac-487b-ab95-c6113f791ef0 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:15.959462 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c2cc38f1-c1ac-487b-ab95-c6113f791ef0 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.229718 May 26 18:20:15.968748 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 146/285] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:15 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:15.968748 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:15.968748 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:15.969374 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e5422a83-c47e-479a-bd89-9f7cf42378ce tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:15.971325 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.971773 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.972523 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:15.972949 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:15.974920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e5422a83-c47e-479a-bd89-9f7cf42378ce tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.221859 May 26 18:20:15.975489 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 140/286] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:15 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:16.116756 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:16.124685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:16.126964 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:16.128116 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7df7f58d-7253-4ad4-b73f-e2284b5858bc tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.167095 May 26 18:20:16.128674 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 147/287] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:15 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:16.393234 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c4ebea54-daab-45d5-8b6a-f160cda0ef90 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:16.393869 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c4ebea54-daab-45d5-8b6a-f160cda0ef90 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:16.399970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c4ebea54-daab-45d5-8b6a-f160cda0ef90 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:16.400416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c4ebea54-daab-45d5-8b6a-f160cda0ef90 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:16.401183 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c4ebea54-daab-45d5-8b6a-f160cda0ef90 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:16.401615 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c4ebea54-daab-45d5-8b6a-f160cda0ef90 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:16.537567 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c4ebea54-daab-45d5-8b6a-f160cda0ef90 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:16.544960 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c4ebea54-daab-45d5-8b6a-f160cda0ef90 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.155704 May 26 18:20:16.545530 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 141/288] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:16 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:16.590596 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d8f3e3b8-35cb-490a-8d54-9c4621bc2615 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:16.591159 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d8f3e3b8-35cb-490a-8d54-9c4621bc2615 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:16.598032 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8f3e3b8-35cb-490a-8d54-9c4621bc2615 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:16.598481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8f3e3b8-35cb-490a-8d54-9c4621bc2615 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:16.599320 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8f3e3b8-35cb-490a-8d54-9c4621bc2615 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:16.599758 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8f3e3b8-35cb-490a-8d54-9c4621bc2615 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:16.619819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:16.734192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d8f3e3b8-35cb-490a-8d54-9c4621bc2615 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:16.742713 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d8f3e3b8-35cb-490a-8d54-9c4621bc2615 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.156278 May 26 18:20:16.743223 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 148/289] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:16 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:16.975947 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4f9157de-3e86-402e-92df-f3d277b6fdcb tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:16.976596 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4f9157de-3e86-402e-92df-f3d277b6fdcb tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:16.983750 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f9157de-3e86-402e-92df-f3d277b6fdcb tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:16.984386 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f9157de-3e86-402e-92df-f3d277b6fdcb tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:16.986416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f9157de-3e86-402e-92df-f3d277b6fdcb tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:16.987195 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f9157de-3e86-402e-92df-f3d277b6fdcb tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:16.992596 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-50aec98d-16e9-4b41-aea0-a2111b64c9c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:16.993203 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-50aec98d-16e9-4b41-aea0-a2111b64c9c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:17.007190 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50aec98d-16e9-4b41-aea0-a2111b64c9c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:17.007681 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50aec98d-16e9-4b41-aea0-a2111b64c9c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:17.008486 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50aec98d-16e9-4b41-aea0-a2111b64c9c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:17.008922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50aec98d-16e9-4b41-aea0-a2111b64c9c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:17.212479 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4f9157de-3e86-402e-92df-f3d277b6fdcb tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:17.216306 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-50aec98d-16e9-4b41-aea0-a2111b64c9c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:17.231688 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-50aec98d-16e9-4b41-aea0-a2111b64c9c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.243008 May 26 18:20:17.232971 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4f9157de-3e86-402e-92df-f3d277b6fdcb tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.260787 May 26 18:20:17.234037 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 149/290] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:16 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:17.240194 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:17.241007 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:17.248074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:17.248757 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:17.249020 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 142/291] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:16 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:17.249931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:17.250745 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:17.394175 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:17.402035 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:17.403532 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:17.404794 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4269e5a5-9d91-4603-9c81-13403fd85070 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.169359 May 26 18:20:17.405359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 150/292] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:17 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:17.563133 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-751676a3-ceae-48b7-a286-7265f6bbcf89 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:17.563855 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-751676a3-ceae-48b7-a286-7265f6bbcf89 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:17.570472 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-751676a3-ceae-48b7-a286-7265f6bbcf89 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:17.570923 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-751676a3-ceae-48b7-a286-7265f6bbcf89 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:17.571679 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-751676a3-ceae-48b7-a286-7265f6bbcf89 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:17.572114 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-751676a3-ceae-48b7-a286-7265f6bbcf89 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:17.717655 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-751676a3-ceae-48b7-a286-7265f6bbcf89 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:17.726284 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-751676a3-ceae-48b7-a286-7265f6bbcf89 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.167490 May 26 18:20:17.726867 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 143/293] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:17 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:17.758997 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e14a4147-afa8-414a-a477-a248690a549d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:17.759603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e14a4147-afa8-414a-a477-a248690a549d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:17.766686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e14a4147-afa8-414a-a477-a248690a549d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:17.767136 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e14a4147-afa8-414a-a477-a248690a549d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:17.767904 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e14a4147-afa8-414a-a477-a248690a549d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:17.768341 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e14a4147-afa8-414a-a477-a248690a549d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:17.908313 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e14a4147-afa8-414a-a477-a248690a549d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:17.916250 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e14a4147-afa8-414a-a477-a248690a549d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.161123 May 26 18:20:17.916819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 151/294] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:17 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:18.249354 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b5b1ff95-5460-4d3b-b66e-411afc2047e4 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:18.253522 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b5b1ff95-5460-4d3b-b66e-411afc2047e4 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:18.263115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b5b1ff95-5460-4d3b-b66e-411afc2047e4 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.264142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b5b1ff95-5460-4d3b-b66e-411afc2047e4 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.268193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b5b1ff95-5460-4d3b-b66e-411afc2047e4 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.268535 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c8a2c274-0110-4708-add6-082031e133a1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:18.268901 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b5b1ff95-5460-4d3b-b66e-411afc2047e4 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.269157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c8a2c274-0110-4708-add6-082031e133a1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:18.277594 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8a2c274-0110-4708-add6-082031e133a1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.278092 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8a2c274-0110-4708-add6-082031e133a1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.279069 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8a2c274-0110-4708-add6-082031e133a1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.279510 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8a2c274-0110-4708-add6-082031e133a1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.485846 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b5b1ff95-5460-4d3b-b66e-411afc2047e4 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:18.491350 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c8a2c274-0110-4708-add6-082031e133a1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:18.494130 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b5b1ff95-5460-4d3b-b66e-411afc2047e4 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.248518 May 26 18:20:18.504767 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 144/295] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:18 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:18.509461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:18.510389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:18.511608 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c8a2c274-0110-4708-add6-082031e133a1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.248805 May 26 18:20:18.521275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 152/296] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:18 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:18.521461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.521461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.521461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.521461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.676809 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:18.684699 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:18.686221 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:18.687369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-560de23f-fc3b-4b55-8b8f-c34413651bf0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.191206 May 26 18:20:18.687986 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 145/297] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:18 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:18.744963 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-07c62ebe-54ea-45a2-808a-ef2bf929644a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:18.746655 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-07c62ebe-54ea-45a2-808a-ef2bf929644a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:18.754768 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07c62ebe-54ea-45a2-808a-ef2bf929644a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.755648 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07c62ebe-54ea-45a2-808a-ef2bf929644a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.756494 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07c62ebe-54ea-45a2-808a-ef2bf929644a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.756931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07c62ebe-54ea-45a2-808a-ef2bf929644a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.898908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-07c62ebe-54ea-45a2-808a-ef2bf929644a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:18.906967 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-07c62ebe-54ea-45a2-808a-ef2bf929644a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.166474 May 26 18:20:18.907863 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 153/298] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:18 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:18.934231 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-54df190d-d6af-4e1c-8510-383065d54343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:18.934847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-54df190d-d6af-4e1c-8510-383065d54343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:18.942606 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54df190d-d6af-4e1c-8510-383065d54343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.943060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54df190d-d6af-4e1c-8510-383065d54343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.943868 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54df190d-d6af-4e1c-8510-383065d54343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.944273 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54df190d-d6af-4e1c-8510-383065d54343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:19.079464 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-54df190d-d6af-4e1c-8510-383065d54343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:19.088217 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-54df190d-d6af-4e1c-8510-383065d54343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.157876 May 26 18:20:19.088796 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 146/299] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:18 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:19.512461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f9dd2741-9ad6-456e-a72a-5a5aa40a9dda tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:19.513166 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f9dd2741-9ad6-456e-a72a-5a5aa40a9dda tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:19.519214 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9dd2741-9ad6-456e-a72a-5a5aa40a9dda tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:19.519661 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9dd2741-9ad6-456e-a72a-5a5aa40a9dda tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:19.520414 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9dd2741-9ad6-456e-a72a-5a5aa40a9dda tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:19.520843 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9dd2741-9ad6-456e-a72a-5a5aa40a9dda tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:19.528974 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4f416657-00f0-4028-854d-83411c1b0be1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:19.530027 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4f416657-00f0-4028-854d-83411c1b0be1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:19.537382 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f416657-00f0-4028-854d-83411c1b0be1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:19.544367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f416657-00f0-4028-854d-83411c1b0be1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:19.545364 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f416657-00f0-4028-854d-83411c1b0be1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:19.545895 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4f416657-00f0-4028-854d-83411c1b0be1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:19.741144 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f9dd2741-9ad6-456e-a72a-5a5aa40a9dda tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:19.744842 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4f416657-00f0-4028-854d-83411c1b0be1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:19.748683 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f9dd2741-9ad6-456e-a72a-5a5aa40a9dda tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.240100 May 26 18:20:19.749252 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 154/300] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:19 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:19.753288 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4f416657-00f0-4028-854d-83411c1b0be1 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.228640 May 26 18:20:19.753657 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:19.754252 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 147/301] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:19 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:19.754377 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:19.760216 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:19.760660 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:19.761421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:19.761886 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:19.894785 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:19.902987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:19.904479 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:19.905623 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-021e4c5a-95b0-4d32-aaa2-85e78d003658 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.155450 May 26 18:20:19.906199 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 155/302] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:19 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:19.925878 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4acfdcb5-80cc-41fb-905b-4d4d7d20095c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:19.926501 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4acfdcb5-80cc-41fb-905b-4d4d7d20095c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:19.932487 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4acfdcb5-80cc-41fb-905b-4d4d7d20095c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:19.932938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4acfdcb5-80cc-41fb-905b-4d4d7d20095c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:19.933709 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4acfdcb5-80cc-41fb-905b-4d4d7d20095c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:19.934174 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4acfdcb5-80cc-41fb-905b-4d4d7d20095c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:20.061417 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4acfdcb5-80cc-41fb-905b-4d4d7d20095c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:20.069029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4acfdcb5-80cc-41fb-905b-4d4d7d20095c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.148526 May 26 18:20:20.069598 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 148/303] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:19 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:20.105911 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-21607849-8f64-40d4-bbe1-53c0f047e468 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:20.106642 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-21607849-8f64-40d4-bbe1-53c0f047e468 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:20.113163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-21607849-8f64-40d4-bbe1-53c0f047e468 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:20.113611 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-21607849-8f64-40d4-bbe1-53c0f047e468 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:20.114414 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-21607849-8f64-40d4-bbe1-53c0f047e468 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:20.114875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-21607849-8f64-40d4-bbe1-53c0f047e468 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:20.240443 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-21607849-8f64-40d4-bbe1-53c0f047e468 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:20.248322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-21607849-8f64-40d4-bbe1-53c0f047e468 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.146264 May 26 18:20:20.248886 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 156/304] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:20 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:20.766920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9f29c6d1-26f4-43ec-ab51-26c93b33ea86 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:20.767976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9f29c6d1-26f4-43ec-ab51-26c93b33ea86 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:20.770860 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8cbe902a-3896-4c0a-9999-922226240f19 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:20.771483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8cbe902a-3896-4c0a-9999-922226240f19 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:20.775876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9f29c6d1-26f4-43ec-ab51-26c93b33ea86 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:20.776631 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9f29c6d1-26f4-43ec-ab51-26c93b33ea86 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:20.777968 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9f29c6d1-26f4-43ec-ab51-26c93b33ea86 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:20.778720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9f29c6d1-26f4-43ec-ab51-26c93b33ea86 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:20.778829 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cbe902a-3896-4c0a-9999-922226240f19 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:20.779201 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cbe902a-3896-4c0a-9999-922226240f19 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:20.780017 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cbe902a-3896-4c0a-9999-922226240f19 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:20.780460 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cbe902a-3896-4c0a-9999-922226240f19 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:21.178371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8cbe902a-3896-4c0a-9999-922226240f19 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:21.181879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9f29c6d1-26f4-43ec-ab51-26c93b33ea86 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:21.189753 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8cbe902a-3896-4c0a-9999-922226240f19 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.423032 May 26 18:20:21.191179 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 157/305] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:20 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:21.192944 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9f29c6d1-26f4-43ec-ab51-26c93b33ea86 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.430802 May 26 18:20:21.193720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 149/306] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:20 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:21.197720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:21.198480 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:21.199010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2a70d347-101c-444f-ae0b-48dc03e73a0c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:21.199810 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2a70d347-101c-444f-ae0b-48dc03e73a0c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:21.208343 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:21.208568 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2a70d347-101c-444f-ae0b-48dc03e73a0c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:21.208870 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:21.209443 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2a70d347-101c-444f-ae0b-48dc03e73a0c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:21.210286 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:21.210664 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2a70d347-101c-444f-ae0b-48dc03e73a0c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:21.210811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:21.211097 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2a70d347-101c-444f-ae0b-48dc03e73a0c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:21.698559 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2a70d347-101c-444f-ae0b-48dc03e73a0c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:21.709401 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2a70d347-101c-444f-ae0b-48dc03e73a0c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.513910 May 26 18:20:21.710886 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 150/307] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:21 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:21.726078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-30637335-a35d-4fec-b636-41867be38208 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:21.726979 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-30637335-a35d-4fec-b636-41867be38208 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:21.746491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-30637335-a35d-4fec-b636-41867be38208 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:21.746491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-30637335-a35d-4fec-b636-41867be38208 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:21.746491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-30637335-a35d-4fec-b636-41867be38208 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:21.746491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-30637335-a35d-4fec-b636-41867be38208 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:21.759245 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:21.775197 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:21.776699 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:21.778088 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0ecb28c8-2b42-4034-a3b0-31d8b1e2e490 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.585655 May 26 18:20:21.779199 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 158/308] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:21 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:21.784411 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-56a354be-6b7e-48d0-86e7-36687727f7d3 req-040b7eec-0a29-4eab-b6b8-2c5c50f35c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97dd8752-9cc1-438c-830c-4f34e8c05fd6", "tag": "baefe40e-bfcc-4cf6-bbb3-6273d240e5d0"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:21.794773 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-56a354be-6b7e-48d0-86e7-36687727f7d3 req-040b7eec-0a29-4eab-b6b8-2c5c50f35c21 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:21.795299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-56a354be-6b7e-48d0-86e7-36687727f7d3 req-040b7eec-0a29-4eab-b6b8-2c5c50f35c21 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:21.809154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-56a354be-6b7e-48d0-86e7-36687727f7d3 req-040b7eec-0a29-4eab-b6b8-2c5c50f35c21 service nova] Creating event network-changed:baefe40e-bfcc-4cf6-bbb3-6273d240e5d0 for instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 on hv-cinder-84349 May 26 18:20:21.815315 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-56a354be-6b7e-48d0-86e7-36687727f7d3 req-040b7eec-0a29-4eab-b6b8-2c5c50f35c21 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034684 May 26 18:20:21.816189 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 159/309] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:22.208311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5e8d18d0-2b23-448c-8abe-2541937095ba tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:22.209035 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5e8d18d0-2b23-448c-8abe-2541937095ba tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:22.217003 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5e8d18d0-2b23-448c-8abe-2541937095ba tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.217457 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5e8d18d0-2b23-448c-8abe-2541937095ba tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:22.218263 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5e8d18d0-2b23-448c-8abe-2541937095ba tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.218707 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5e8d18d0-2b23-448c-8abe-2541937095ba tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:22.325458 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-30637335-a35d-4fec-b636-41867be38208 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:22.334528 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-30637335-a35d-4fec-b636-41867be38208 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.622061 May 26 18:20:22.335106 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 151/310] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:21 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:22.339735 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8e91ee65-f7c9-4dfe-baf6-0c5c24ab0e1f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:22.340341 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8e91ee65-f7c9-4dfe-baf6-0c5c24ab0e1f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:22.346997 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8e91ee65-f7c9-4dfe-baf6-0c5c24ab0e1f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.347450 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8e91ee65-f7c9-4dfe-baf6-0c5c24ab0e1f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:22.348218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8e91ee65-f7c9-4dfe-baf6-0c5c24ab0e1f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.348814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8e91ee65-f7c9-4dfe-baf6-0c5c24ab0e1f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:22.351787 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=100 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:22.654779 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5e8d18d0-2b23-448c-8abe-2541937095ba tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:22.663439 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5e8d18d0-2b23-448c-8abe-2541937095ba tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.459347 May 26 18:20:22.664035 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 160/311] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:22 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:22.701131 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8e91ee65-f7c9-4dfe-baf6-0c5c24ab0e1f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:22.709055 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8e91ee65-f7c9-4dfe-baf6-0c5c24ab0e1f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.372891 May 26 18:20:22.709543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 152/312] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:22 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:22.728482 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1db79623-667c-4ded-b8d2-93adefe3795a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:22.729174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1db79623-667c-4ded-b8d2-93adefe3795a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:22.736313 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1db79623-667c-4ded-b8d2-93adefe3795a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.736835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1db79623-667c-4ded-b8d2-93adefe3795a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:22.737678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1db79623-667c-4ded-b8d2-93adefe3795a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.738226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1db79623-667c-4ded-b8d2-93adefe3795a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:22.796428 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:22.797076 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:22.804445 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.804899 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:22.805671 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.806163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.083795 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1db79623-667c-4ded-b8d2-93adefe3795a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:23.092489 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1db79623-667c-4ded-b8d2-93adefe3795a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.367705 May 26 18:20:23.093162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 161/313] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:22 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:23.100178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-ec9f55e3-775d-4435-b5ae-0c8dcef833aa req-e27acc9c-95d2-4e47-aa8b-f0948830b3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4de072-ccdb-491d-aa9c-71019c7dcb72", "tag": "e57de911-af42-44da-842d-d2a882b8ef20"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:23.118860 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ec9f55e3-775d-4435-b5ae-0c8dcef833aa req-e27acc9c-95d2-4e47-aa8b-f0948830b3f4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.119296 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ec9f55e3-775d-4435-b5ae-0c8dcef833aa req-e27acc9c-95d2-4e47-aa8b-f0948830b3f4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.124933 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:23.135600 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-ec9f55e3-775d-4435-b5ae-0c8dcef833aa req-e27acc9c-95d2-4e47-aa8b-f0948830b3f4 service nova] Creating event network-changed:e57de911-af42-44da-842d-d2a882b8ef20 for instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 on hv-cinder-84349 May 26 18:20:23.135866 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:23.137629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:23.139344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9fe4f62e-7275-4123-b491-f4b2c5398dfd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.346878 May 26 18:20:23.142351 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-ec9f55e3-775d-4435-b5ae-0c8dcef833aa req-e27acc9c-95d2-4e47-aa8b-f0948830b3f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045700 May 26 18:20:23.143206 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 162/314] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:23.150474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 153/315] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:22 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:23.352981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ca877562-904b-48a0-b5c9-bf6858992ed5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:23.353885 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ca877562-904b-48a0-b5c9-bf6858992ed5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:23.360441 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ca877562-904b-48a0-b5c9-bf6858992ed5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.360981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ca877562-904b-48a0-b5c9-bf6858992ed5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.362028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ca877562-904b-48a0-b5c9-bf6858992ed5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.362539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ca877562-904b-48a0-b5c9-bf6858992ed5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.682100 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-06df0dd4-6241-4f90-a2fe-3782346dcc87 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:23.683433 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-06df0dd4-6241-4f90-a2fe-3782346dcc87 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:23.684850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ca877562-904b-48a0-b5c9-bf6858992ed5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:23.691464 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-06df0dd4-6241-4f90-a2fe-3782346dcc87 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.692230 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-06df0dd4-6241-4f90-a2fe-3782346dcc87 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.693229 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-06df0dd4-6241-4f90-a2fe-3782346dcc87 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.693951 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-06df0dd4-6241-4f90-a2fe-3782346dcc87 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.698527 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ca877562-904b-48a0-b5c9-bf6858992ed5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.349694 May 26 18:20:23.709936 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 163/316] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:23 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:23.729028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-77657d05-77f9-423a-a211-eb51d48bb65b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:23.730571 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-77657d05-77f9-423a-a211-eb51d48bb65b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:23.739035 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-77657d05-77f9-423a-a211-eb51d48bb65b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.739389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-77657d05-77f9-423a-a211-eb51d48bb65b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.740459 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-77657d05-77f9-423a-a211-eb51d48bb65b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.741150 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-77657d05-77f9-423a-a211-eb51d48bb65b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.951072 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-06df0dd4-6241-4f90-a2fe-3782346dcc87 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:23.958664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-77657d05-77f9-423a-a211-eb51d48bb65b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:23.959546 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-06df0dd4-6241-4f90-a2fe-3782346dcc87 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.281792 May 26 18:20:23.960124 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 154/317] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:23 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:23.966277 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-77657d05-77f9-423a-a211-eb51d48bb65b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.241821 May 26 18:20:23.966833 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 164/318] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:23 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:24.111167 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2d56afa7-315f-4397-8d84-fcc1d470fb64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:24.111698 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2d56afa7-315f-4397-8d84-fcc1d470fb64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:24.117749 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2d56afa7-315f-4397-8d84-fcc1d470fb64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:24.118222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2d56afa7-315f-4397-8d84-fcc1d470fb64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:24.118988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2d56afa7-315f-4397-8d84-fcc1d470fb64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:24.119427 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2d56afa7-315f-4397-8d84-fcc1d470fb64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:24.160065 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:24.160714 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:24.166877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:24.167326 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:24.168098 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:24.168538 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:24.302784 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2d56afa7-315f-4397-8d84-fcc1d470fb64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:24.310174 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2d56afa7-315f-4397-8d84-fcc1d470fb64 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.203484 May 26 18:20:24.310747 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 155/319] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:24 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:24.332585 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:24.340493 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:24.342022 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:24.343171 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-13f8b0a3-4877-4a72-91de-543c3f4b5da5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.187876 May 26 18:20:24.343859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 165/320] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:24 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:24.716349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-293391db-cfae-4e00-a4b5-4a2d9823101b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:24.716967 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-293391db-cfae-4e00-a4b5-4a2d9823101b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:24.723210 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-293391db-cfae-4e00-a4b5-4a2d9823101b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:24.723666 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-293391db-cfae-4e00-a4b5-4a2d9823101b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:24.724444 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-293391db-cfae-4e00-a4b5-4a2d9823101b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:24.724881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-293391db-cfae-4e00-a4b5-4a2d9823101b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:24.978389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6a6b412a-03fe-478c-9feb-5d9329043ad9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:24.979700 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6a6b412a-03fe-478c-9feb-5d9329043ad9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:24.986478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6a6b412a-03fe-478c-9feb-5d9329043ad9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:24.986928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6a6b412a-03fe-478c-9feb-5d9329043ad9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:24.987719 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6a6b412a-03fe-478c-9feb-5d9329043ad9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:24.988352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6a6b412a-03fe-478c-9feb-5d9329043ad9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:25.008370 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:25.057153 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-293391db-cfae-4e00-a4b5-4a2d9823101b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:25.065883 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-293391db-cfae-4e00-a4b5-4a2d9823101b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1724 microversion: 2.1 time: 0.353358 May 26 18:20:25.066472 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 156/321] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:24 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:25.071082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-19b82a9d-89d6-44d3-a600-3c28c517319e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:25.071694 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-19b82a9d-89d6-44d3-a600-3c28c517319e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:25.078014 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-19b82a9d-89d6-44d3-a600-3c28c517319e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:25.079406 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-19b82a9d-89d6-44d3-a600-3c28c517319e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:25.080258 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-19b82a9d-89d6-44d3-a600-3c28c517319e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:25.080768 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-19b82a9d-89d6-44d3-a600-3c28c517319e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:25.419123 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6a6b412a-03fe-478c-9feb-5d9329043ad9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:25.428190 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6a6b412a-03fe-478c-9feb-5d9329043ad9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.453571 May 26 18:20:25.428770 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 166/322] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:24 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:25.433977 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-c7653eae-fd44-49e3-8a35-53377b53f8d9 req-5c56b242-3107-4f59-a703-7eb1f517b920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37c198f-b170-4773-8436-c52a8d5b934b", "tag": "c471eca6-7897-4bd4-980d-b46e7fcc2133"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:25.443632 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-c7653eae-fd44-49e3-8a35-53377b53f8d9 req-5c56b242-3107-4f59-a703-7eb1f517b920 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:25.444337 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-c7653eae-fd44-49e3-8a35-53377b53f8d9 req-5c56b242-3107-4f59-a703-7eb1f517b920 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:25.456333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-c7653eae-fd44-49e3-8a35-53377b53f8d9 req-5c56b242-3107-4f59-a703-7eb1f517b920 service nova] Creating event network-changed:c471eca6-7897-4bd4-980d-b46e7fcc2133 for instance b37c198f-b170-4773-8436-c52a8d5b934b on hv-cinder-84349 May 26 18:20:25.461696 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-c7653eae-fd44-49e3-8a35-53377b53f8d9 req-5c56b242-3107-4f59-a703-7eb1f517b920 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031632 May 26 18:20:25.462603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 167/323] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:25.469541 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fc1e92df-1b42-44d5-964d-3d954897920f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:25.470634 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fc1e92df-1b42-44d5-964d-3d954897920f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:25.478409 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc1e92df-1b42-44d5-964d-3d954897920f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:25.478757 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-19b82a9d-89d6-44d3-a600-3c28c517319e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:25.479389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc1e92df-1b42-44d5-964d-3d954897920f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:25.480172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc1e92df-1b42-44d5-964d-3d954897920f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:25.481388 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc1e92df-1b42-44d5-964d-3d954897920f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:25.492893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-19b82a9d-89d6-44d3-a600-3c28c517319e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.425102 May 26 18:20:25.494151 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 157/324] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:25 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:25.500256 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:25.501812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:25.508935 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:25.509479 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:25.510390 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:25.510897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.107690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fc1e92df-1b42-44d5-964d-3d954897920f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:26.116335 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fc1e92df-1b42-44d5-964d-3d954897920f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.652266 May 26 18:20:26.119798 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:26.126144 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 168/325] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:25 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:26.128608 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:26.130143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:26.130966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-754ee97e-9f73-43c1-ae7b-452d13651058 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:26.131302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-643f71b4-6e90-48fc-bde5-e4954d031e3b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.636037 May 26 18:20:26.131564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-754ee97e-9f73-43c1-ae7b-452d13651058 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:26.131846 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 158/326] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:25 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:26.137368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-754ee97e-9f73-43c1-ae7b-452d13651058 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.137838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-754ee97e-9f73-43c1-ae7b-452d13651058 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.138583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-754ee97e-9f73-43c1-ae7b-452d13651058 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.139008 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-754ee97e-9f73-43c1-ae7b-452d13651058 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.268193 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-754ee97e-9f73-43c1-ae7b-452d13651058 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:26.276293 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-754ee97e-9f73-43c1-ae7b-452d13651058 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1701 microversion: 2.1 time: 0.148915 May 26 18:20:26.276868 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 169/327] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:26 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1701 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:26.293469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8ff9ee2e-bf76-4f51-99f2-31913e578f07 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:26.300135 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8ff9ee2e-bf76-4f51-99f2-31913e578f07 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.300611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8ff9ee2e-bf76-4f51-99f2-31913e578f07 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.322540 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8ff9ee2e-bf76-4f51-99f2-31913e578f07 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Going to try to start instance {{(pid=117697) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 18:20:26.365155 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8ff9ee2e-bf76-4f51-99f2-31913e578f07 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/action" status: 202 len: 0 microversion: 2.1 time: 0.075480 May 26 18:20:26.365781 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 159/328] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:20:26 2022] POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:20:26.374809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2b5a1817-50cd-430e-aed8-a67728263106 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:26.375922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2b5a1817-50cd-430e-aed8-a67728263106 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:26.382013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b5a1817-50cd-430e-aed8-a67728263106 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.382466 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b5a1817-50cd-430e-aed8-a67728263106 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.383217 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b5a1817-50cd-430e-aed8-a67728263106 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.383661 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2b5a1817-50cd-430e-aed8-a67728263106 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.448043 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1ac9fc38-19ca-48d2-9816-a2c52ea02b22 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:26.449008 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1ac9fc38-19ca-48d2-9816-a2c52ea02b22 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:26.456923 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1ac9fc38-19ca-48d2-9816-a2c52ea02b22 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.457765 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1ac9fc38-19ca-48d2-9816-a2c52ea02b22 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.458191 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1ac9fc38-19ca-48d2-9816-a2c52ea02b22 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.458622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1ac9fc38-19ca-48d2-9816-a2c52ea02b22 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.551384 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2b5a1817-50cd-430e-aed8-a67728263106 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:26.559891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2b5a1817-50cd-430e-aed8-a67728263106 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1710 microversion: 2.1 time: 0.189874 May 26 18:20:26.560474 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 170/329] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:26 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1710 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:26.569624 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0fff74ee-514e-430f-a7c6-4eec649ed53b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:26.569624 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0fff74ee-514e-430f-a7c6-4eec649ed53b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:26.572791 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0fff74ee-514e-430f-a7c6-4eec649ed53b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.573183 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0fff74ee-514e-430f-a7c6-4eec649ed53b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.573972 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0fff74ee-514e-430f-a7c6-4eec649ed53b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:26.574411 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0fff74ee-514e-430f-a7c6-4eec649ed53b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:26.608128 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1ac9fc38-19ca-48d2-9816-a2c52ea02b22 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:26.618225 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1ac9fc38-19ca-48d2-9816-a2c52ea02b22 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.176991 May 26 18:20:26.619031 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 160/330] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:26 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:26.711178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0fff74ee-514e-430f-a7c6-4eec649ed53b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:26.718629 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0fff74ee-514e-430f-a7c6-4eec649ed53b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.157230 May 26 18:20:26.719960 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 171/331] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:26 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:27.132938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8c39e23a-8f23-4e03-89fe-cd1b5c1244e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:27.133543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8c39e23a-8f23-4e03-89fe-cd1b5c1244e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:27.140048 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8c39e23a-8f23-4e03-89fe-cd1b5c1244e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.140496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8c39e23a-8f23-4e03-89fe-cd1b5c1244e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:27.141921 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8c39e23a-8f23-4e03-89fe-cd1b5c1244e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.142355 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8c39e23a-8f23-4e03-89fe-cd1b5c1244e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:27.150637 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:27.151260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:27.157574 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.158058 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:27.158828 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.159265 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:27.520498 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8c39e23a-8f23-4e03-89fe-cd1b5c1244e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:27.529356 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8c39e23a-8f23-4e03-89fe-cd1b5c1244e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.400159 May 26 18:20:27.530271 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 161/332] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:27 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:27.535729 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-ec26b895-4b23-42e0-a638-7d826e8135cb req-ff69699f-9e1b-4785-9623-700cc8fd8af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37c198f-b170-4773-8436-c52a8d5b934b", "name": "network-vif-plugged", "status": "completed", "tag": "c471eca6-7897-4bd4-980d-b46e7fcc2133"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:27.545210 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ec26b895-4b23-42e0-a638-7d826e8135cb req-ff69699f-9e1b-4785-9623-700cc8fd8af7 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.545980 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ec26b895-4b23-42e0-a638-7d826e8135cb req-ff69699f-9e1b-4785-9623-700cc8fd8af7 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:27.559025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-ec26b895-4b23-42e0-a638-7d826e8135cb req-ff69699f-9e1b-4785-9623-700cc8fd8af7 service nova] Creating event network-vif-plugged:c471eca6-7897-4bd4-980d-b46e7fcc2133 for instance b37c198f-b170-4773-8436-c52a8d5b934b on hv-cinder-84349 May 26 18:20:27.565742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-ec26b895-4b23-42e0-a638-7d826e8135cb req-ff69699f-9e1b-4785-9623-700cc8fd8af7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034079 May 26 18:20:27.566635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 162/333] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:27.579995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a8c716a2-3972-4500-90b6-9caf62b813e2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:27.580977 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a8c716a2-3972-4500-90b6-9caf62b813e2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:27.585260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:27.599298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:27.600782 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8c716a2-3972-4500-90b6-9caf62b813e2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.601362 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8c716a2-3972-4500-90b6-9caf62b813e2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:27.602331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8c716a2-3972-4500-90b6-9caf62b813e2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.602813 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:27.602949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8c716a2-3972-4500-90b6-9caf62b813e2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:27.604531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c33c5d77-ca60-4f0b-b917-72c48595b9b8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.458310 May 26 18:20:27.606299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 172/334] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:27 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:27.637881 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a5ee4992-b221-40eb-ab27-bca0dd1877d9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:27.638862 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a5ee4992-b221-40eb-ab27-bca0dd1877d9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:27.651178 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a5ee4992-b221-40eb-ab27-bca0dd1877d9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.652114 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a5ee4992-b221-40eb-ab27-bca0dd1877d9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:27.653506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a5ee4992-b221-40eb-ab27-bca0dd1877d9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:27.654189 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a5ee4992-b221-40eb-ab27-bca0dd1877d9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:28.031838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a5ee4992-b221-40eb-ab27-bca0dd1877d9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:28.034859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a8c716a2-3972-4500-90b6-9caf62b813e2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:28.039145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a5ee4992-b221-40eb-ab27-bca0dd1877d9 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.406614 May 26 18:20:28.039716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 173/335] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:27 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:28.043334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a8c716a2-3972-4500-90b6-9caf62b813e2 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1710 microversion: 2.1 time: 0.468823 May 26 18:20:28.044055 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 163/336] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:27 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1710 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:28.044262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dceb376e-cd5c-4fb5-953b-3618a181061a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:28.044950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dceb376e-cd5c-4fb5-953b-3618a181061a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:28.051617 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dceb376e-cd5c-4fb5-953b-3618a181061a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:28.052065 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dceb376e-cd5c-4fb5-953b-3618a181061a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:28.052834 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dceb376e-cd5c-4fb5-953b-3618a181061a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:28.053268 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dceb376e-cd5c-4fb5-953b-3618a181061a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:28.265151 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-dceb376e-cd5c-4fb5-953b-3618a181061a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:28.274108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-dceb376e-cd5c-4fb5-953b-3618a181061a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1358 microversion: 2.1 time: 0.233341 May 26 18:20:28.274881 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 174/337] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:28 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:28.548068 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f7b772b2-c5cf-42ef-bb03-585fd1c72c01 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:28.548591 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f7b772b2-c5cf-42ef-bb03-585fd1c72c01 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:28.554704 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f7b772b2-c5cf-42ef-bb03-585fd1c72c01 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:28.555152 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f7b772b2-c5cf-42ef-bb03-585fd1c72c01 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:28.555905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f7b772b2-c5cf-42ef-bb03-585fd1c72c01 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:28.556344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f7b772b2-c5cf-42ef-bb03-585fd1c72c01 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:28.623885 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:28.624493 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:28.631496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:28.631950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:28.632714 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:28.633148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:28.715124 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f7b772b2-c5cf-42ef-bb03-585fd1c72c01 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:28.723434 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f7b772b2-c5cf-42ef-bb03-585fd1c72c01 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.179892 May 26 18:20:28.724013 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 164/338] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:28 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:28.836058 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:28.844159 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:28.845681 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:28.846874 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-48af70a1-aa8f-4c80-bb7e-32684d98b265 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.226911 May 26 18:20:28.847431 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 175/339] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:28 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:29.056609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4fbe0c1f-3ae4-4aef-b1d7-473744f8fc29 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:29.057229 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4fbe0c1f-3ae4-4aef-b1d7-473744f8fc29 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:29.060870 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3a36e745-a6c4-43d4-9ca1-c8768c3c03b8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:29.061488 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3a36e745-a6c4-43d4-9ca1-c8768c3c03b8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:29.063879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4fbe0c1f-3ae4-4aef-b1d7-473744f8fc29 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.064308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4fbe0c1f-3ae4-4aef-b1d7-473744f8fc29 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.065076 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4fbe0c1f-3ae4-4aef-b1d7-473744f8fc29 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.065514 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4fbe0c1f-3ae4-4aef-b1d7-473744f8fc29 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.068465 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a36e745-a6c4-43d4-9ca1-c8768c3c03b8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.068938 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a36e745-a6c4-43d4-9ca1-c8768c3c03b8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.069686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a36e745-a6c4-43d4-9ca1-c8768c3c03b8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.070146 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3a36e745-a6c4-43d4-9ca1-c8768c3c03b8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.262208 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3a36e745-a6c4-43d4-9ca1-c8768c3c03b8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:29.264095 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4fbe0c1f-3ae4-4aef-b1d7-473744f8fc29 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:29.273271 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3a36e745-a6c4-43d4-9ca1-c8768c3c03b8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1710 microversion: 2.1 time: 0.215977 May 26 18:20:29.285944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 176/340] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:29 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1710 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:29.286286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4fbe0c1f-3ae4-4aef-b1d7-473744f8fc29 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.231613 May 26 18:20:29.286819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 165/341] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:29 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:29.294916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0752e160-6ed5-4f11-bb87-bbf1657168eb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:29.294916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0752e160-6ed5-4f11-bb87-bbf1657168eb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:29.302306 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0752e160-6ed5-4f11-bb87-bbf1657168eb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.302930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0752e160-6ed5-4f11-bb87-bbf1657168eb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.303718 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0752e160-6ed5-4f11-bb87-bbf1657168eb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.304158 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0752e160-6ed5-4f11-bb87-bbf1657168eb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.453107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0752e160-6ed5-4f11-bb87-bbf1657168eb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:29.461432 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0752e160-6ed5-4f11-bb87-bbf1657168eb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1548 microversion: 2.1 time: 0.171278 May 26 18:20:29.461973 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 177/342] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:29 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:29.478848 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0c16afee-8f4e-430b-a177-106e358fd772 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:29.479475 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0c16afee-8f4e-430b-a177-106e358fd772 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:29.486253 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0c16afee-8f4e-430b-a177-106e358fd772 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.486706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0c16afee-8f4e-430b-a177-106e358fd772 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.487490 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0c16afee-8f4e-430b-a177-106e358fd772 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.487930 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0c16afee-8f4e-430b-a177-106e358fd772 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.618090 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0c16afee-8f4e-430b-a177-106e358fd772 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:29.625796 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0c16afee-8f4e-430b-a177-106e358fd772 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1548 microversion: 2.1 time: 0.150773 May 26 18:20:29.626349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 166/343] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:29 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:29.641454 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:29.644904 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:29.645656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Searching by: {'deleted': False, 'project_id': 'd08521617c884fe9a67609887f0ddaae'} {{(pid=117696) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 18:20:29.652161 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.652590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.653361 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.653808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.669971 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-85bfedb0-fbb0-4421-b51c-a87d090f06d0 req-7a1c0182-96cd-4391-b6d0-041ebb5552c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97dd8752-9cc1-438c-830c-4f34e8c05fd6", "name": "network-vif-plugged", "status": "completed", "tag": "baefe40e-bfcc-4cf6-bbb3-6273d240e5d0"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:29.679112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-85bfedb0-fbb0-4421-b51c-a87d090f06d0 req-7a1c0182-96cd-4391-b6d0-041ebb5552c4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.679563 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-85bfedb0-fbb0-4421-b51c-a87d090f06d0 req-7a1c0182-96cd-4391-b6d0-041ebb5552c4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.691237 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-85bfedb0-fbb0-4421-b51c-a87d090f06d0 req-7a1c0182-96cd-4391-b6d0-041ebb5552c4 service nova] Creating event network-vif-plugged:baefe40e-bfcc-4cf6-bbb3-6273d240e5d0 for instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 on hv-cinder-84349 May 26 18:20:29.698941 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-85bfedb0-fbb0-4421-b51c-a87d090f06d0 req-7a1c0182-96cd-4391-b6d0-041ebb5552c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032577 May 26 18:20:29.699549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 167/344] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:20:29.740381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-79b31c04-9aa3-46ae-aca3-554059f060d0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:29.741088 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-79b31c04-9aa3-46ae-aca3-554059f060d0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:29.747368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-79b31c04-9aa3-46ae-aca3-554059f060d0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.747823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-79b31c04-9aa3-46ae-aca3-554059f060d0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.748586 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-79b31c04-9aa3-46ae-aca3-554059f060d0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.749026 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-79b31c04-9aa3-46ae-aca3-554059f060d0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.755510 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.multi_cell_list [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117696) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 18:20:29.855089 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-108ec2fe-4654-4c91-8b1c-925fc47a1934 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.217527 May 26 18:20:29.855679 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 178/345] 10.222.0.46 () {58 vars in 1124 bytes} [Thu May 26 18:20:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:29.864745 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:29.865432 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:29.871663 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.872192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.873030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.873543 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.912389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-79b31c04-9aa3-46ae-aca3-554059f060d0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:29.920328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-79b31c04-9aa3-46ae-aca3-554059f060d0 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.184203 May 26 18:20:29.929744 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 168/346] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:29 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:29.929744 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-598beb39-a7ea-45f1-9591-e36167965d31 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:29.929744 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-598beb39-a7ea-45f1-9591-e36167965d31 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:29.933381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-598beb39-a7ea-45f1-9591-e36167965d31 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.933937 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-598beb39-a7ea-45f1-9591-e36167965d31 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.934765 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-598beb39-a7ea-45f1-9591-e36167965d31 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:29.935267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-598beb39-a7ea-45f1-9591-e36167965d31 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:29.938253 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:30.076966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:30.084989 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:30.086504 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:30.087648 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1667524a-93e0-4f80-8440-6b637ac44199 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.226876 May 26 18:20:30.088198 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 179/347] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:29 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:30.106075 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-598beb39-a7ea-45f1-9591-e36167965d31 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:30.114595 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-598beb39-a7ea-45f1-9591-e36167965d31 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1548 microversion: 2.1 time: 0.192106 May 26 18:20:30.115169 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 169/348] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:29 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1548 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:30.294083 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d8912db0-737f-42e1-bf3b-a7c7cac7aa0d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:30.294690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d8912db0-737f-42e1-bf3b-a7c7cac7aa0d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:30.302156 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-18dae2b7-d1d5-4e35-b0c6-f5acb2de6b7c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:30.303099 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-18dae2b7-d1d5-4e35-b0c6-f5acb2de6b7c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:30.303603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8912db0-737f-42e1-bf3b-a7c7cac7aa0d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:30.304191 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8912db0-737f-42e1-bf3b-a7c7cac7aa0d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:30.304961 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8912db0-737f-42e1-bf3b-a7c7cac7aa0d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:30.305567 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d8912db0-737f-42e1-bf3b-a7c7cac7aa0d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:30.310642 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-18dae2b7-d1d5-4e35-b0c6-f5acb2de6b7c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:30.310642 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-18dae2b7-d1d5-4e35-b0c6-f5acb2de6b7c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:30.311370 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-18dae2b7-d1d5-4e35-b0c6-f5acb2de6b7c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:30.311995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-18dae2b7-d1d5-4e35-b0c6-f5acb2de6b7c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:30.543058 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-18dae2b7-d1d5-4e35-b0c6-f5acb2de6b7c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:30.547540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d8912db0-737f-42e1-bf3b-a7c7cac7aa0d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:30.552311 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-18dae2b7-d1d5-4e35-b0c6-f5acb2de6b7c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.255414 May 26 18:20:30.552890 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 170/349] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:30 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:30.557227 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d8912db0-737f-42e1-bf3b-a7c7cac7aa0d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1714 microversion: 2.1 time: 0.268486 May 26 18:20:30.557819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 180/350] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:30 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1714 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:30.936549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8ff8212b-26f0-494e-a2b0-93c83660260c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:30.937185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8ff8212b-26f0-494e-a2b0-93c83660260c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:30.944368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8ff8212b-26f0-494e-a2b0-93c83660260c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:30.944822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8ff8212b-26f0-494e-a2b0-93c83660260c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:30.945598 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8ff8212b-26f0-494e-a2b0-93c83660260c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:30.946070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8ff8212b-26f0-494e-a2b0-93c83660260c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:31.075709 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8ff8212b-26f0-494e-a2b0-93c83660260c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:31.084609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8ff8212b-26f0-494e-a2b0-93c83660260c tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.151886 May 26 18:20:31.085202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 171/351] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:30 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:31.106578 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:31.107187 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:31.113328 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:31.113843 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:31.114642 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:31.115079 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:31.252663 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:31.260696 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:31.262269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:31.263436 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cb754525-95ca-4469-adef-a0a2ff061c6f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.160866 May 26 18:20:31.263995 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 181/352] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:31 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:31.569646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-851cee4e-1d0f-4b2c-974d-0aabe5fbf152 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:31.570310 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-851cee4e-1d0f-4b2c-974d-0aabe5fbf152 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:31.576368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-851cee4e-1d0f-4b2c-974d-0aabe5fbf152 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:31.576813 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-851cee4e-1d0f-4b2c-974d-0aabe5fbf152 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:31.577632 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-851cee4e-1d0f-4b2c-974d-0aabe5fbf152 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:31.578930 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-851cee4e-1d0f-4b2c-974d-0aabe5fbf152 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:31.687957 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d2bfab23-3647-4844-b761-966462f7c41b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eee07d41-1c97-49e6-891e-e74a6a585cc9"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:31.689395 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d2bfab23-3647-4844-b761-966462f7c41b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:31.697702 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d2bfab23-3647-4844-b761-966462f7c41b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:31.698276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d2bfab23-3647-4844-b761-966462f7c41b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:31.699173 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d2bfab23-3647-4844-b761-966462f7c41b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:31.699760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d2bfab23-3647-4844-b761-966462f7c41b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:31.719807 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-851cee4e-1d0f-4b2c-974d-0aabe5fbf152 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:31.728260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-851cee4e-1d0f-4b2c-974d-0aabe5fbf152 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.162435 May 26 18:20:31.728847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 172/353] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:31 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:31.742764 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-9aefa835-e525-4bd1-8e99-9e08fe301e6d req-62d54f79-b1f0-42b0-9669-f2265ce5c346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4de072-ccdb-491d-aa9c-71019c7dcb72", "name": "network-vif-plugged", "status": "completed", "tag": "e57de911-af42-44da-842d-d2a882b8ef20"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:31.751711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-9aefa835-e525-4bd1-8e99-9e08fe301e6d req-62d54f79-b1f0-42b0-9669-f2265ce5c346 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:31.752153 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-9aefa835-e525-4bd1-8e99-9e08fe301e6d req-62d54f79-b1f0-42b0-9669-f2265ce5c346 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:31.763316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-9aefa835-e525-4bd1-8e99-9e08fe301e6d req-62d54f79-b1f0-42b0-9669-f2265ce5c346 service nova] Creating event network-vif-plugged:e57de911-af42-44da-842d-d2a882b8ef20 for instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 on hv-cinder-84349 May 26 18:20:31.769648 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-9aefa835-e525-4bd1-8e99-9e08fe301e6d req-62d54f79-b1f0-42b0-9669-f2265ce5c346 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030479 May 26 18:20:31.770377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 173/354] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:31.997316 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:32.019154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d2bfab23-3647-4844-b761-966462f7c41b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "POST /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335572 May 26 18:20:32.019774 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 182/355] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:20:31 2022] POST /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:20:32.105514 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-353ed7af-ea8f-4bd9-9d8a-9cfc13f6e0da tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:32.106248 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-353ed7af-ea8f-4bd9-9d8a-9cfc13f6e0da tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:32.108150 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=100 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:32.114672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-353ed7af-ea8f-4bd9-9d8a-9cfc13f6e0da tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:32.115184 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-353ed7af-ea8f-4bd9-9d8a-9cfc13f6e0da tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:32.115947 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-353ed7af-ea8f-4bd9-9d8a-9cfc13f6e0da tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:32.116380 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-353ed7af-ea8f-4bd9-9d8a-9cfc13f6e0da tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:32.245533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-353ed7af-ea8f-4bd9-9d8a-9cfc13f6e0da tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:32.253792 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-353ed7af-ea8f-4bd9-9d8a-9cfc13f6e0da tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1370 microversion: 2.1 time: 0.152846 May 26 18:20:32.254371 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 174/356] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:32 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:32.282620 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:32.283308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:32.290062 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:32.290513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:32.291273 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:32.291709 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:32.419232 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:32.428237 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:32.429685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:32.430871 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4b7c1e76-6bfe-44be-8f28-9c1eee575f90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.152570 May 26 18:20:32.431426 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 183/357] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:32 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:32.744359 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-402ed296-2401-4bb9-a54d-ce8f0b51f8cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:32.744976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-402ed296-2401-4bb9-a54d-ce8f0b51f8cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:32.751058 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-402ed296-2401-4bb9-a54d-ce8f0b51f8cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:32.751502 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-402ed296-2401-4bb9-a54d-ce8f0b51f8cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:32.752313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-402ed296-2401-4bb9-a54d-ce8f0b51f8cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:32.752748 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-402ed296-2401-4bb9-a54d-ce8f0b51f8cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:32.876895 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-402ed296-2401-4bb9-a54d-ce8f0b51f8cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:32.884304 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-402ed296-2401-4bb9-a54d-ce8f0b51f8cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.143838 May 26 18:20:32.884901 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 175/358] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:32 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:33.269986 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-aec61d81-251f-4d4b-934d-f1933e200640 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:33.270525 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-aec61d81-251f-4d4b-934d-f1933e200640 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:33.277033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aec61d81-251f-4d4b-934d-f1933e200640 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:33.277489 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aec61d81-251f-4d4b-934d-f1933e200640 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:33.278310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aec61d81-251f-4d4b-934d-f1933e200640 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:33.278754 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aec61d81-251f-4d4b-934d-f1933e200640 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:33.409014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-aec61d81-251f-4d4b-934d-f1933e200640 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:33.418032 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-aec61d81-251f-4d4b-934d-f1933e200640 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1564 microversion: 2.1 time: 0.151975 May 26 18:20:33.418615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 184/359] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:33 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:33.435213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-649e8766-47d3-4973-a687-56e88d692956 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:33.435716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-649e8766-47d3-4973-a687-56e88d692956 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:33.442705 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-649e8766-47d3-4973-a687-56e88d692956 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:33.443192 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-649e8766-47d3-4973-a687-56e88d692956 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:33.443966 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-649e8766-47d3-4973-a687-56e88d692956 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:33.444412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-649e8766-47d3-4973-a687-56e88d692956 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:33.449655 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:33.450316 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:33.457305 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:33.457769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:33.458536 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:33.459008 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:33.555159 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-649e8766-47d3-4973-a687-56e88d692956 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123724 May 26 18:20:33.555873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 176/360] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 18:20:33 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:33.616111 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:33.624095 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:33.626389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:33.627604 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8c736181-acdd-4b80-98a0-290395f06e4e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.181879 May 26 18:20:33.628164 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 185/361] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:33 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:33.901920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bc8cfb04-f043-41aa-ad53-b6d85e6079ee tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:33.902531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-bc8cfb04-f043-41aa-ad53-b6d85e6079ee tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:33.910391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc8cfb04-f043-41aa-ad53-b6d85e6079ee tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:33.911098 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc8cfb04-f043-41aa-ad53-b6d85e6079ee tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:33.911869 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc8cfb04-f043-41aa-ad53-b6d85e6079ee tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:33.912298 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc8cfb04-f043-41aa-ad53-b6d85e6079ee tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:34.053331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bc8cfb04-f043-41aa-ad53-b6d85e6079ee tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:34.060873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-bc8cfb04-f043-41aa-ad53-b6d85e6079ee tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1315 microversion: 2.1 time: 0.162838 May 26 18:20:34.061441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 177/362] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:33 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:34.475980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-bf2ed0c4-898a-46d9-b732-c53210840017 req-449fc634-33a8-4f6f-9102-bd58e7a19f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97dd8752-9cc1-438c-830c-4f34e8c05fd6", "tag": "baefe40e-bfcc-4cf6-bbb3-6273d240e5d0"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:34.485429 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bf2ed0c4-898a-46d9-b732-c53210840017 req-449fc634-33a8-4f6f-9102-bd58e7a19f78 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:34.486245 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-bf2ed0c4-898a-46d9-b732-c53210840017 req-449fc634-33a8-4f6f-9102-bd58e7a19f78 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:34.500848 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-bf2ed0c4-898a-46d9-b732-c53210840017 req-449fc634-33a8-4f6f-9102-bd58e7a19f78 service nova] Creating event network-changed:baefe40e-bfcc-4cf6-bbb3-6273d240e5d0 for instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 on hv-cinder-84349 May 26 18:20:34.507471 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-bf2ed0c4-898a-46d9-b732-c53210840017 req-449fc634-33a8-4f6f-9102-bd58e7a19f78 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035063 May 26 18:20:34.508336 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 186/363] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:34.647952 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:34.648567 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:34.655263 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:34.655714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:34.656667 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:34.657103 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:34.785263 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:34.793350 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:34.794908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:34.796065 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b90b5730-3f02-416a-914a-5b6e4184a2c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.153247 May 26 18:20:34.796944 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 178/364] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:34 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:35.077718 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-575934b5-ce47-4156-9093-95554971de38 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:35.078547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-575934b5-ce47-4156-9093-95554971de38 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:35.084768 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-575934b5-ce47-4156-9093-95554971de38 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:35.085221 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-575934b5-ce47-4156-9093-95554971de38 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:35.086020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-575934b5-ce47-4156-9093-95554971de38 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:35.086466 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-575934b5-ce47-4156-9093-95554971de38 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:35.219352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-575934b5-ce47-4156-9093-95554971de38 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:35.230594 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-575934b5-ce47-4156-9093-95554971de38 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1465 microversion: 2.1 time: 0.156978 May 26 18:20:35.231262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 187/365] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:35 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:35.273077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-30ec5a8b-c078-4262-850b-c6da20ad25cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:35.273579 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-30ec5a8b-c078-4262-850b-c6da20ad25cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:35.279858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-30ec5a8b-c078-4262-850b-c6da20ad25cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:35.280315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-30ec5a8b-c078-4262-850b-c6da20ad25cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:35.281694 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-30ec5a8b-c078-4262-850b-c6da20ad25cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:35.282330 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-30ec5a8b-c078-4262-850b-c6da20ad25cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:35.309036 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-30ec5a8b-c078-4262-850b-c6da20ad25cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:20:35.388141 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-30ec5a8b-c078-4262-850b-c6da20ad25cd tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 204 len: 0 microversion: 2.1 time: 0.119374 May 26 18:20:35.388738 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 179/366] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:20:35 2022] DELETE /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:20:35.397370 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-77f6d967-d8ff-49c9-b39c-d607ad062b84 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:35.398008 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-77f6d967-d8ff-49c9-b39c-d607ad062b84 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:35.404137 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-77f6d967-d8ff-49c9-b39c-d607ad062b84 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:35.404588 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-77f6d967-d8ff-49c9-b39c-d607ad062b84 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:35.405360 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-77f6d967-d8ff-49c9-b39c-d607ad062b84 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:35.405850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-77f6d967-d8ff-49c9-b39c-d607ad062b84 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:35.543226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-77f6d967-d8ff-49c9-b39c-d607ad062b84 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:35.551831 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-77f6d967-d8ff-49c9-b39c-d607ad062b84 tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1471 microversion: 2.1 time: 0.158371 May 26 18:20:35.552402 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 188/367] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:35 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:35.815252 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:35.815963 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:35.822495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:35.822951 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:35.823773 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:35.824217 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:35.958300 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:35.966418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:35.968003 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:35.969708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ce979e41-ff26-4853-99c5-7fa5ded1fb1f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.158885 May 26 18:20:35.970309 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 180/368] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:35 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:36.569198 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ba00f1bf-04a1-49ac-8c64-6b3f1039bc2c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:36.569719 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ba00f1bf-04a1-49ac-8c64-6b3f1039bc2c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:36.576218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba00f1bf-04a1-49ac-8c64-6b3f1039bc2c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:36.576673 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba00f1bf-04a1-49ac-8c64-6b3f1039bc2c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:36.577440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba00f1bf-04a1-49ac-8c64-6b3f1039bc2c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:36.577957 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ba00f1bf-04a1-49ac-8c64-6b3f1039bc2c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:36.704017 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ba00f1bf-04a1-49ac-8c64-6b3f1039bc2c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:36.711744 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ba00f1bf-04a1-49ac-8c64-6b3f1039bc2c tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1471 microversion: 2.1 time: 0.146477 May 26 18:20:36.712322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 189/369] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:36 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:36.988085 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:36.988778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:36.995888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:36.996341 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:36.997155 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:36.997577 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:37.130776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:37.138666 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:37.140165 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:37.142200 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d7499896-f6a7-4e4f-be98-06b4acb1d3b2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.158384 May 26 18:20:37.142758 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 181/370] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:36 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:37.730165 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6884098a-32c3-48ca-892a-60a9f2538dfc tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:37.730777 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6884098a-32c3-48ca-892a-60a9f2538dfc tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:37.738756 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6884098a-32c3-48ca-892a-60a9f2538dfc tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:37.739212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6884098a-32c3-48ca-892a-60a9f2538dfc tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:37.739989 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6884098a-32c3-48ca-892a-60a9f2538dfc tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:37.740429 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6884098a-32c3-48ca-892a-60a9f2538dfc tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:38.068636 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6884098a-32c3-48ca-892a-60a9f2538dfc tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:38.076069 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6884098a-32c3-48ca-892a-60a9f2538dfc tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1471 microversion: 2.1 time: 0.350187 May 26 18:20:38.076638 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 190/371] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:37 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1471 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:38.160496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:38.161093 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:38.167527 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:38.167973 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:38.168736 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:38.169348 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:38.417361 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:38.426819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:38.428333 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:38.429885 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8fb1181e-d651-4ef7-ace1-33406023c8ae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1745 microversion: 2.20 time: 0.273508 May 26 18:20:38.430359 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 182/372] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:38 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:38.570848 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3e8b7459-27c4-435a-b014-13cf3954e001 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:38.571746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3e8b7459-27c4-435a-b014-13cf3954e001 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:38.578449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3e8b7459-27c4-435a-b014-13cf3954e001 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:38.579025 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3e8b7459-27c4-435a-b014-13cf3954e001 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:38.580003 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3e8b7459-27c4-435a-b014-13cf3954e001 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:38.580618 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3e8b7459-27c4-435a-b014-13cf3954e001 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:38.596768 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-d206aafc-cb03-4eb6-bc07-f2bd438a36a5 req-0b0c3ee4-a4f3-45f2-a5ab-fc9191a9f3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4de072-ccdb-491d-aa9c-71019c7dcb72", "name": "network-vif-deleted", "tag": "e57de911-af42-44da-842d-d2a882b8ef20"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:38.611076 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-d206aafc-cb03-4eb6-bc07-f2bd438a36a5 req-0b0c3ee4-a4f3-45f2-a5ab-fc9191a9f3ec service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:38.611772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-d206aafc-cb03-4eb6-bc07-f2bd438a36a5 req-0b0c3ee4-a4f3-45f2-a5ab-fc9191a9f3ec service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:38.623834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-d206aafc-cb03-4eb6-bc07-f2bd438a36a5 req-0b0c3ee4-a4f3-45f2-a5ab-fc9191a9f3ec service nova] Creating event network-vif-deleted:e57de911-af42-44da-842d-d2a882b8ef20 for instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 on hv-cinder-84349 May 26 18:20:38.629291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-d206aafc-cb03-4eb6-bc07-f2bd438a36a5 req-0b0c3ee4-a4f3-45f2-a5ab-fc9191a9f3ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036654 May 26 18:20:38.630433 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 183/373] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:20:38.738288 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3e8b7459-27c4-435a-b014-13cf3954e001 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:38.746945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3e8b7459-27c4-435a-b014-13cf3954e001 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1594 microversion: 2.1 time: 0.179852 May 26 18:20:38.749413 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 191/374] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:38 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1594 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:39.093289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:39.094878 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:39.101556 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:39.102053 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:39.102819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:39.103261 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:39.136072 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:39.136524 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:39.136979 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lazy-loading 'fault' on Instance uuid 7b4de072-ccdb-491d-aa9c-71019c7dcb72 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:20:39.200531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba793692ba62427a86d52880f1f659a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e8074335b04d60987b4f8b1371a9bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:39.213491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-46832bc6-fd1c-4846-940b-fd2777bce6ff tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 200 len: 1305 microversion: 2.1 time: 0.124477 May 26 18:20:39.222612 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 184/375] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:39 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:39.451233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:39.452070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:39.460434 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:39.466292 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:39.466733 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:39.467504 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:39.468094 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:39.688647 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:39.717388 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:39.726431 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:39.728182 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:39.729362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8a4e030f-5f62-462b-abc6-ca50cdd979f3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1745 microversion: 2.20 time: 0.282525 May 26 18:20:39.729974 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 192/376] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:39 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1745 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:40.232461 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:40.233166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] [instance: 7b4de072-ccdb-491d-aa9c-71019c7dcb72] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:40.240507 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:40.240962 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:40.241755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:40.242197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:40.256642 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] HTTP exception thrown: Instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 could not be found. May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Request method failure captured: May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 HTTP/1.1 May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8TNRS9JmQ-hgS5vi53gZOfNiVL7ZFQhhD6iv7UMOAJ8jWPuoKpvx2gVEur56cJFYQLh3CxO8ERAqhcTjUG4tU5dFec7eZmphzfYkDH-Gh0GNv5gJ-EAWIADODLUPcjKdJEvayk2BHxUD0SgeqtSl7viXgLTGYygpMIoonrv7lLQ9s4 May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 73e8074335b04d60987b4f8b1371a9bb May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-VolumesNegativeTest-166936062 May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:20:40.258334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73e8074335b04d60987b4f8b1371a9bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73e8074335b04d60987b4f8b1371a9bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/73e8074335b04d60987b4f8b1371a9bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_73e8074335b04d60987b4f8b1371a9bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-VolumesNegativeTest-166936062 May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 73e8074335b04d60987b4f8b1371a9bb May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-VolumesNegativeTest-166936062 May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-VolumesNegativeTest-166936062-project May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: ba793692ba62427a86d52880f1f659a8 May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-VolumesNegativeTest-166936062-project May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 could not be found. May 26 18:20:40.259876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '7b4de072-ccdb-491d-aa9c-71019c7dcb72'} May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 could not be found. May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:20:40.260716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 could not be found. May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 could not be found. May 26 18:20:40.262193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:20:40.264012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] Returning 404 to user: Instance 7b4de072-ccdb-491d-aa9c-71019c7dcb72 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:20:40.264012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-29261304-458e-449c-bf51-e29f30e1a2ac tempest-VolumesNegativeTest-166936062 tempest-VolumesNegativeTest-166936062-project] 10.222.0.46 "GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72" status: 404 len: 111 microversion: 2.1 time: 0.031230 May 26 18:20:40.264012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 185/377] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:40 2022] GET /compute/v2.1/servers/7b4de072-ccdb-491d-aa9c-71019c7dcb72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:20:40.688283 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-5618c1dc-abf2-4259-ab11-02e93737f2dd req-e8d0c08e-615c-463a-a984-c92d88a2217d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37c198f-b170-4773-8436-c52a8d5b934b", "tag": "c471eca6-7897-4bd4-980d-b46e7fcc2133"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:40.723487 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-5618c1dc-abf2-4259-ab11-02e93737f2dd req-e8d0c08e-615c-463a-a984-c92d88a2217d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:40.724290 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-5618c1dc-abf2-4259-ab11-02e93737f2dd req-e8d0c08e-615c-463a-a984-c92d88a2217d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:40.743067 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-5618c1dc-abf2-4259-ab11-02e93737f2dd req-e8d0c08e-615c-463a-a984-c92d88a2217d service nova] Creating event network-changed:c471eca6-7897-4bd4-980d-b46e7fcc2133 for instance b37c198f-b170-4773-8436-c52a8d5b934b on hv-cinder-84349 May 26 18:20:40.754644 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:40.755260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:40.758654 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-5618c1dc-abf2-4259-ab11-02e93737f2dd req-e8d0c08e-615c-463a-a984-c92d88a2217d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074264 May 26 18:20:40.759844 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 193/378] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:40.772440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:40.772886 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:40.773955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:40.774350 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:40.801654 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:41.559913 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:41.579209 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:41.587819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:41.589261 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-bc59e386-3452-4ec5-a910-63cf8f331529 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.845097 May 26 18:20:41.601900 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 186/379] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:40 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:41.671572 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-00175622-277a-4c90-b146-3717f8142ad7 req-90b3308d-999d-4b81-93a1-512e0cacd956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0eeeed-f9b7-4526-bd2f-ac98a769fd80", "name": "network-vif-plugged", "status": "completed", "tag": "1d3fd217-af97-47a7-9225-e698208d450f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:41.690136 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-00175622-277a-4c90-b146-3717f8142ad7 req-90b3308d-999d-4b81-93a1-512e0cacd956 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:41.691412 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-00175622-277a-4c90-b146-3717f8142ad7 req-90b3308d-999d-4b81-93a1-512e0cacd956 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:41.720659 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-00175622-277a-4c90-b146-3717f8142ad7 req-90b3308d-999d-4b81-93a1-512e0cacd956 service nova] Creating event network-vif-plugged:1d3fd217-af97-47a7-9225-e698208d450f for instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 on hv-cinder-84349 May 26 18:20:41.731511 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-00175622-277a-4c90-b146-3717f8142ad7 req-90b3308d-999d-4b81-93a1-512e0cacd956 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064814 May 26 18:20:41.738348 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 194/380] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:42.577496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1ee45151-9af2-47c2-a8d1-5d572848ec9a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-176781714"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:42.579767 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1ee45151-9af2-47c2-a8d1-5d572848ec9a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:42.590999 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1ee45151-9af2-47c2-a8d1-5d572848ec9a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:42.599323 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1ee45151-9af2-47c2-a8d1-5d572848ec9a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:42.600759 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1ee45151-9af2-47c2-a8d1-5d572848ec9a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:42.604167 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1ee45151-9af2-47c2-a8d1-5d572848ec9a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:42.617236 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:42.617678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:42.628322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:42.629392 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:42.630928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:42.631412 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:43.012846 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:43.029019 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:43.031607 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:43.034645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ccfa3ac1-3035-4ad4-8ecf-1929efaafee9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.425340 May 26 18:20:43.035230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 195/381] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:42 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:43.056878 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.network.security_group_api [None req-1ee45151-9af2-47c2-a8d1-5d572848ec9a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Adding security group 4f9cbdde-e96f-4bcd-91e0-e81c8dd4b618 to port c471eca6-7897-4bd4-980d-b46e7fcc2133 May 26 18:20:43.750038 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1ee45151-9af2-47c2-a8d1-5d572848ec9a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "POST /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/action" status: 202 len: 0 microversion: 2.1 time: 1.176430 May 26 18:20:43.751039 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 187/382] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:20:42 2022] POST /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/action => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:20:43.759599 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fbdb1bee-06c0-479c-bb75-c3ea37cec743 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:43.760273 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fbdb1bee-06c0-479c-bb75-c3ea37cec743 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:43.767278 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-61a5f2c6-7a0d-4384-aeb3-f64f9d46b26e req-d51aeeb5-1479-400b-b8de-e510d8691875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37c198f-b170-4773-8436-c52a8d5b934b", "tag": "c471eca6-7897-4bd4-980d-b46e7fcc2133"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:43.786134 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbdb1bee-06c0-479c-bb75-c3ea37cec743 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:43.786594 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbdb1bee-06c0-479c-bb75-c3ea37cec743 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:43.787414 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbdb1bee-06c0-479c-bb75-c3ea37cec743 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:43.787906 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbdb1bee-06c0-479c-bb75-c3ea37cec743 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:43.807224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-61a5f2c6-7a0d-4384-aeb3-f64f9d46b26e req-d51aeeb5-1479-400b-b8de-e510d8691875 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:43.807696 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-61a5f2c6-7a0d-4384-aeb3-f64f9d46b26e req-d51aeeb5-1479-400b-b8de-e510d8691875 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:43.835882 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-61a5f2c6-7a0d-4384-aeb3-f64f9d46b26e req-d51aeeb5-1479-400b-b8de-e510d8691875 service nova] Creating event network-changed:c471eca6-7897-4bd4-980d-b46e7fcc2133 for instance b37c198f-b170-4773-8436-c52a8d5b934b on hv-cinder-84349 May 26 18:20:43.846615 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-61a5f2c6-7a0d-4384-aeb3-f64f9d46b26e req-d51aeeb5-1479-400b-b8de-e510d8691875 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084160 May 26 18:20:43.851743 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 188/383] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:44.056130 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:44.056986 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:44.079891 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:44.082332 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:44.086814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:44.088400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:44.364572 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fbdb1bee-06c0-479c-bb75-c3ea37cec743 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:44.375592 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fbdb1bee-06c0-479c-bb75-c3ea37cec743 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1759 microversion: 2.1 time: 0.619641 May 26 18:20:44.394250 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 196/384] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:43 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1759 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:44.448962 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:44.459553 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:44.463539 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:44.470722 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c0113535-e7c2-4474-94c2-cabbe43f28d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.419719 May 26 18:20:44.483704 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 189/385] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:44 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:45.490152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:45.491704 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:45.500310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:45.501226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:45.502305 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:45.502831 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:45.651157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:45.660503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:45.662071 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:45.663291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-61bf9ffa-5767-459c-99e9-4dae86cfc739 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.177178 May 26 18:20:45.663866 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 197/386] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:45 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:46.683072 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:46.683830 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:46.695111 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:46.695665 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:46.696550 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:46.697058 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:46.894650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:46.905285 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:46.908087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:46.909283 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b726bf05-2ecf-4a17-a3b5-5370099a7197 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.231247 May 26 18:20:46.920960 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 190/387] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:46 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:47.928279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:47.928891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:47.935780 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:47.936437 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:47.938051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:47.938865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:48.114438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:48.129392 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:48.135871 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:48.137422 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f01217f7-1c5a-4f27-ac8e-ef063e756841 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.213419 May 26 18:20:48.152268 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 198/388] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:47 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:49.157065 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:49.157864 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:49.169469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:49.170746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:49.172100 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:49.172764 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:49.356216 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:49.367142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:49.368896 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:49.370350 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d25a0fce-67d4-4f94-83d2-1ecfb4ae6ade tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.217467 May 26 18:20:49.371094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 191/389] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:49 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:50.382677 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e83e5958-3367-4c96-aea1-41c2314f4c24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:50.383242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e83e5958-3367-4c96-aea1-41c2314f4c24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:50.391277 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:50.392087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:50.401742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.402245 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.403106 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.403588 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.410256 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e83e5958-3367-4c96-aea1-41c2314f4c24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.410936 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e83e5958-3367-4c96-aea1-41c2314f4c24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.411862 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e83e5958-3367-4c96-aea1-41c2314f4c24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.412440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e83e5958-3367-4c96-aea1-41c2314f4c24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.450621 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e83e5958-3367-4c96-aea1-41c2314f4c24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c/ips" status: 200 len: 151 microversion: 2.1 time: 0.072414 May 26 18:20:50.451460 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 199/390] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:20:50 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c/ips => generated 151 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:50.463809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:50.466432 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:50.476898 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.477528 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.478507 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.481040 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.602103 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Invalid volume: volume ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1 is already attached to instances: 158ce769-fde9-413e-81f3-d76b3222b5fc May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: POST /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c/os-volume_attachments HTTP/1.1 May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 74 May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:20:50.604822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {"volumeAttachment": {"volumeId": "ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1"}} May 26 18:20:50.606425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Invalid volume: volume ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1 is already attached to instances: 158ce769-fde9-413e-81f3-d76b3222b5fc May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'server_id': 'dca22358-3d8a-4a3c-a5e9-cb003a11cf2c', 'body': {'volumeAttachment': {'volumeId': 'ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1'}}} May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1 is already attached to instances: 158ce769-fde9-413e-81f3-d76b3222b5fc May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:20:50.607513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1 is already attached to instances: 158ce769-fde9-413e-81f3-d76b3222b5fc May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:20:50.608669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:20:50.610947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:20:50.610947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:20:50.610947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:20:50.610947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1 is already attached to instances: 158ce769-fde9-413e-81f3-d76b3222b5fc May 26 18:20:50.610947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:20:50.610947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 400 to user: Invalid volume: volume ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1 is already attached to instances: 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:20:50.610947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cdeed7d0-e3b3-469c-8170-f09e98664399 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.146639 May 26 18:20:50.610947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 200/391] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:20:50 2022] POST /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c/os-volume_attachments => generated 174 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:20:50.618780 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6e2983cd-c8a6-41d6-bba2-ac838309bbe0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:50.619261 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6e2983cd-c8a6-41d6-bba2-ac838309bbe0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:50.627207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:50.637391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:50.638925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:50.640080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-26664649-4c14-4077-9c68-4b2165ea6cbd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.253040 May 26 18:20:50.640664 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 192/392] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:50 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:50.643051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e2983cd-c8a6-41d6-bba2-ac838309bbe0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.643516 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e2983cd-c8a6-41d6-bba2-ac838309bbe0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.644294 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e2983cd-c8a6-41d6-bba2-ac838309bbe0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.644727 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e2983cd-c8a6-41d6-bba2-ac838309bbe0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.668853 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:50.677791 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6e2983cd-c8a6-41d6-bba2-ac838309bbe0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:20:50.790439 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6e2983cd-c8a6-41d6-bba2-ac838309bbe0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 204 len: 0 microversion: 2.1 time: 0.175544 May 26 18:20:50.800618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e53ae42e-ed26-4fdc-a366-cad87878eb73 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:50.801289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e53ae42e-ed26-4fdc-a366-cad87878eb73 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:50.804796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 201/393] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:20:50 2022] DELETE /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:20:50.810362 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e53ae42e-ed26-4fdc-a366-cad87878eb73 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.810812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e53ae42e-ed26-4fdc-a366-cad87878eb73 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.811594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e53ae42e-ed26-4fdc-a366-cad87878eb73 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:50.812025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e53ae42e-ed26-4fdc-a366-cad87878eb73 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:50.972341 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e53ae42e-ed26-4fdc-a366-cad87878eb73 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:50.980573 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e53ae42e-ed26-4fdc-a366-cad87878eb73 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1683 microversion: 2.1 time: 0.184568 May 26 18:20:50.987329 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 193/394] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:50 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:51.660104 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:51.660845 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:51.667672 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:51.668122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:51.668906 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:51.669334 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:51.813934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:51.822193 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:51.823946 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:51.825350 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-648c2555-1d49-42a5-a600-31d60045438d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.170159 May 26 18:20:51.836732 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 202/395] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:51 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:51.999065 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d25af3c6-6ea1-49b9-b4bf-3f6960487699 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:52.003599 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d25af3c6-6ea1-49b9-b4bf-3f6960487699 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:52.010706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d25af3c6-6ea1-49b9-b4bf-3f6960487699 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:52.011185 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d25af3c6-6ea1-49b9-b4bf-3f6960487699 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:52.011945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d25af3c6-6ea1-49b9-b4bf-3f6960487699 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:52.012539 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d25af3c6-6ea1-49b9-b4bf-3f6960487699 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:52.160791 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d25af3c6-6ea1-49b9-b4bf-3f6960487699 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:52.168724 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d25af3c6-6ea1-49b9-b4bf-3f6960487699 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1683 microversion: 2.1 time: 0.173725 May 26 18:20:52.169917 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 194/396] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:51 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:52.844298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:52.844828 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:52.851218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:52.851663 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:52.852420 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:52.852854 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:52.985039 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:52.994470 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:52.995842 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:52.996998 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-211aff4c-f321-4883-94bb-c58d507a7cf8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.156837 May 26 18:20:52.997539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 203/397] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:52 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:53.186668 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-efbee191-db8c-4071-bcc2-24f5bb3fe258 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:53.187926 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-efbee191-db8c-4071-bcc2-24f5bb3fe258 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:53.194412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-efbee191-db8c-4071-bcc2-24f5bb3fe258 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:53.194862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-efbee191-db8c-4071-bcc2-24f5bb3fe258 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:53.195619 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-efbee191-db8c-4071-bcc2-24f5bb3fe258 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:53.196055 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-efbee191-db8c-4071-bcc2-24f5bb3fe258 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:53.330660 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-efbee191-db8c-4071-bcc2-24f5bb3fe258 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:53.338224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-efbee191-db8c-4071-bcc2-24f5bb3fe258 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1683 microversion: 2.1 time: 0.155424 May 26 18:20:53.338790 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 195/398] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:53 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:54.016586 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:54.017194 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:54.025007 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:54.025646 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:54.026620 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:54.027140 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:54.164384 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:54.172295 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:54.174077 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:54.175225 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ed2bece1-fd28-4744-997c-3a69a58f4645 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.163210 May 26 18:20:54.175779 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 204/399] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:54 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:54.356477 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e7026dbf-6f1c-4663-ba27-7957e32aa69b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:54.357128 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e7026dbf-6f1c-4663-ba27-7957e32aa69b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:54.363907 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e7026dbf-6f1c-4663-ba27-7957e32aa69b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:54.364364 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e7026dbf-6f1c-4663-ba27-7957e32aa69b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:54.365127 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e7026dbf-6f1c-4663-ba27-7957e32aa69b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:54.365568 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e7026dbf-6f1c-4663-ba27-7957e32aa69b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:54.493834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e7026dbf-6f1c-4663-ba27-7957e32aa69b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:54.501555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e7026dbf-6f1c-4663-ba27-7957e32aa69b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1683 microversion: 2.1 time: 0.149044 May 26 18:20:54.502163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 196/400] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:54 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:55.193195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:55.193831 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:55.200379 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:55.200839 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:55.201850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:55.202298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:55.334290 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:55.342153 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:55.343669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:55.344896 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-26278c72-c3af-4958-b698-c41d2d168580 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.155628 May 26 18:20:55.345439 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 205/401] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:55 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:20:55.519074 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-38ce8d75-09f4-43ec-9968-c1e7d7ff7d81 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:55.519634 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-38ce8d75-09f4-43ec-9968-c1e7d7ff7d81 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:55.526070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-38ce8d75-09f4-43ec-9968-c1e7d7ff7d81 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:55.526513 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-38ce8d75-09f4-43ec-9968-c1e7d7ff7d81 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:55.527291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-38ce8d75-09f4-43ec-9968-c1e7d7ff7d81 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:55.527719 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-38ce8d75-09f4-43ec-9968-c1e7d7ff7d81 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:55.660630 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-38ce8d75-09f4-43ec-9968-c1e7d7ff7d81 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:55.668155 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-38ce8d75-09f4-43ec-9968-c1e7d7ff7d81 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1683 microversion: 2.1 time: 0.153035 May 26 18:20:55.668729 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 197/402] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:55 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:56.363434 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:56.364044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:56.370583 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:56.371042 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:56.371805 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:56.372242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:56.501135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:56.509126 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:56.510666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:56.511859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-364caa7a-5889-4769-90c9-4f002a21e4a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1740 microversion: 2.20 time: 0.152879 May 26 18:20:56.512408 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 206/403] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:56 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:56.685335 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7d3bf06e-4118-4a61-8de4-dbcad39118f7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:56.686020 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7d3bf06e-4118-4a61-8de4-dbcad39118f7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:56.692549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d3bf06e-4118-4a61-8de4-dbcad39118f7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:56.692999 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d3bf06e-4118-4a61-8de4-dbcad39118f7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:56.693778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d3bf06e-4118-4a61-8de4-dbcad39118f7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:56.694220 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d3bf06e-4118-4a61-8de4-dbcad39118f7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:56.822385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7d3bf06e-4118-4a61-8de4-dbcad39118f7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:56.830503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7d3bf06e-4118-4a61-8de4-dbcad39118f7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1683 microversion: 2.1 time: 0.148964 May 26 18:20:56.831071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 198/404] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:56 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:57.434231 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-8f66e476-ca69-43fd-8a87-40761b7dcd13 req-c31a95db-d9f0-4e37-b584-0a36791487b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0eeeed-f9b7-4526-bd2f-ac98a769fd80", "name": "network-vif-unplugged", "status": "completed", "tag": "1d3fd217-af97-47a7-9225-e698208d450f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:57.444368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-8f66e476-ca69-43fd-8a87-40761b7dcd13 req-c31a95db-d9f0-4e37-b584-0a36791487b0 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:57.444827 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-8f66e476-ca69-43fd-8a87-40761b7dcd13 req-c31a95db-d9f0-4e37-b584-0a36791487b0 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:57.460008 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-8f66e476-ca69-43fd-8a87-40761b7dcd13 req-c31a95db-d9f0-4e37-b584-0a36791487b0 service nova] Creating event network-vif-unplugged:1d3fd217-af97-47a7-9225-e698208d450f for instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 on hv-cinder-84349 May 26 18:20:57.464782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-8f66e476-ca69-43fd-8a87-40761b7dcd13 req-c31a95db-d9f0-4e37-b584-0a36791487b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034216 May 26 18:20:57.465956 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 207/405] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:57.530377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:57.531031 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:57.537051 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:57.537444 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:57.538332 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:57.538774 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:57.849018 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-09c5ab65-0359-402e-9dc1-d8f9cdf0cd17 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:57.849713 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-09c5ab65-0359-402e-9dc1-d8f9cdf0cd17 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:57.856014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09c5ab65-0359-402e-9dc1-d8f9cdf0cd17 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:57.856466 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09c5ab65-0359-402e-9dc1-d8f9cdf0cd17 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:57.857232 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09c5ab65-0359-402e-9dc1-d8f9cdf0cd17 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:57.857669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-09c5ab65-0359-402e-9dc1-d8f9cdf0cd17 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:58.180149 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:58.189406 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:58.190960 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:58.192362 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ac70898c-32e7-441a-a32d-d1b1267174a3 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1722 microversion: 2.20 time: 0.665941 May 26 18:20:58.192927 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 199/406] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:57 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1722 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:58.394879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-09c5ab65-0359-402e-9dc1-d8f9cdf0cd17 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:58.402389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-09c5ab65-0359-402e-9dc1-d8f9cdf0cd17 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1683 microversion: 2.1 time: 0.557707 May 26 18:20:58.402966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 208/407] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:57 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1683 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:20:58.794658 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-be96eef0-496f-4348-b82c-18e16ba30372 req-208679c0-ca75-42b0-b5ec-32ceeb4c6667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca22358-3d8a-4a3c-a5e9-cb003a11cf2c", "name": "network-vif-deleted", "tag": "6d78a0b7-1afb-456a-9a08-dc8ea964b7b7"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:58.803026 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-be96eef0-496f-4348-b82c-18e16ba30372 req-208679c0-ca75-42b0-b5ec-32ceeb4c6667 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:58.803464 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-be96eef0-496f-4348-b82c-18e16ba30372 req-208679c0-ca75-42b0-b5ec-32ceeb4c6667 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:58.815562 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-be96eef0-496f-4348-b82c-18e16ba30372 req-208679c0-ca75-42b0-b5ec-32ceeb4c6667 service nova] Creating event network-vif-deleted:6d78a0b7-1afb-456a-9a08-dc8ea964b7b7 for instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c on hv-cinder-84349 May 26 18:20:58.820734 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-be96eef0-496f-4348-b82c-18e16ba30372 req-208679c0-ca75-42b0-b5ec-32ceeb4c6667 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029950 May 26 18:20:58.821400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 200/408] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:59.211551 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:59.212220 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:59.219375 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:59.219826 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:59.228244 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:59.228943 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:59.376401 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:59.385998 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:59.387512 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:59.388720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-637ba997-fb34-4326-8674-dc1620de09a4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1722 microversion: 2.20 time: 0.181151 May 26 18:20:59.389489 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 209/409] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:20:59 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:20:59.420799 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f06e3675-9615-42bb-965a-63b47b69b27a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:59.421592 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f06e3675-9615-42bb-965a-63b47b69b27a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:59.428278 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f06e3675-9615-42bb-965a-63b47b69b27a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:59.428724 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f06e3675-9615-42bb-965a-63b47b69b27a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:59.429491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f06e3675-9615-42bb-965a-63b47b69b27a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:59.429955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f06e3675-9615-42bb-965a-63b47b69b27a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:59.500042 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f06e3675-9615-42bb-965a-63b47b69b27a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:59.507983 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f06e3675-9615-42bb-965a-63b47b69b27a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1615 microversion: 2.1 time: 0.091331 May 26 18:20:59.508690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 201/410] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:20:59 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1615 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:00.407374 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:00.408105 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:00.414655 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:00.415100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:00.415852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:00.416284 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:00.526465 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8692e2aa-ffd7-4386-9791-3e77498f7bb6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:00.527248 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8692e2aa-ffd7-4386-9791-3e77498f7bb6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:00.534791 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8692e2aa-ffd7-4386-9791-3e77498f7bb6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:00.535392 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8692e2aa-ffd7-4386-9791-3e77498f7bb6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:00.536314 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8692e2aa-ffd7-4386-9791-3e77498f7bb6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:00.536851 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8692e2aa-ffd7-4386-9791-3e77498f7bb6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:00.553245 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:00.561901 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:00.564475 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:00.565832 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-dc1c0f34-f264-4a0e-8c9c-87badcd1e91d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1722 microversion: 2.20 time: 0.162336 May 26 18:21:00.566427 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 210/411] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:00 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:00.601517 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8692e2aa-ffd7-4386-9791-3e77498f7bb6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:00.609659 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8692e2aa-ffd7-4386-9791-3e77498f7bb6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1615 microversion: 2.1 time: 0.086736 May 26 18:21:00.610606 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 202/412] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:00 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:01.584360 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:01.585074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:01.591532 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:01.591977 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:01.592746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:01.593664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:01.626876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:01.627488 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:01.634560 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:01.635017 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:01.635859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:01.636303 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:01.667571 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:01.668022 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:01.668474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid dca22358-3d8a-4a3c-a5e9-cb003a11cf2c {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:01.718786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:01.726171 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8f48074c-12ca-4dc8-a5ba-f2bbfc87c42a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1331 microversion: 2.1 time: 0.103424 May 26 18:21:01.726747 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 203/413] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:01 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:01.748019 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:01.755993 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:01.757489 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:01.758672 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7aa4a9af-8d8b-4c30-b2a7-a993fe66a47f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1722 microversion: 2.20 time: 0.178229 May 26 18:21:01.759223 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 211/414] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:01 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:02.743906 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:02.744665 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:02.747077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:02.753071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:02.753521 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:02.754349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:02.754815 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:02.759541 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=100 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:02.778016 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:02.778714 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:02.791033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:02.791033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:02.791033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:02.791033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:02.791344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:02.791344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:02.791344 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid dca22358-3d8a-4a3c-a5e9-cb003a11cf2c {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:02.832567 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:02.841063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-526052c1-09e0-4eb4-b63b-f66f92c2be6f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 200 len: 1331 microversion: 2.1 time: 0.100572 May 26 18:21:02.842713 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 204/415] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:02 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:02.931580 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:02.939523 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:02.941017 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:02.942210 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7c627d2d-5b75-4fb7-ba20-c750b52dac07 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1722 microversion: 2.20 time: 0.169688 May 26 18:21:02.942765 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 212/416] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:02 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:03.858637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:03.859250 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:03.866395 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:03.866844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:03.867605 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:03.868044 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:03.881298 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c HTTP/1.1 May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:21:03.882872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:21:03.884471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'dca22358-3d8a-4a3c-a5e9-cb003a11cf2c'} May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:21:03.885343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:21:03.886881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:21:03.888118 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:21:03.888118 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9cfe113e-e794-4c1b-a879-b1fb4669464d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 404 len: 111 microversion: 2.1 time: 0.029522 May 26 18:21:03.888118 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 205/417] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:03 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:21:03.892938 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-46f76794-cef5-424e-b02f-11a9ed64bf37 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '.version_select at 0x7f5f18538790>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:03.911279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-46f76794-cef5-424e-b02f-11a9ed64bf37 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-715014839" status: 202 len: 0 microversion: 2.1 time: 0.022115 May 26 18:21:03.911885 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 213/418] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 18:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-715014839 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:21:03.960811 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:03.961482 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:03.968116 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:03.968272 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:03.969579 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:03.969579 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.162444 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:04.171256 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:04.173030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:04.174468 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-77eb7e92-2e3d-4565-9f54-059d0fb1e366 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1665 microversion: 2.20 time: 0.217675 May 26 18:21:04.175010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 206/419] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:03 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1665 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:04.192847 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-41513fc6-bff4-49b4-b160-abdf27a0eeda tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96f6e19a-507f-40c5-8f66-e47b9f4fe868"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:04.193936 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-41513fc6-bff4-49b4-b160-abdf27a0eeda tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:04.200402 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-41513fc6-bff4-49b4-b160-abdf27a0eeda tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.200860 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-41513fc6-bff4-49b4-b160-abdf27a0eeda tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.201635 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-41513fc6-bff4-49b4-b160-abdf27a0eeda tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.202107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-41513fc6-bff4-49b4-b160-abdf27a0eeda tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.512879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-41513fc6-bff4-49b4-b160-abdf27a0eeda tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324796 May 26 18:21:04.513507 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 214/420] 10.222.0.46 () {62 vars in 1363 bytes} [Thu May 26 18:21:04 2022] POST /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:21:04.636077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9e0dcbc6-5d80-4d81-b00a-08ff19a2e787 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:04.636647 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9e0dcbc6-5d80-4d81-b00a-08ff19a2e787 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:04.642827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e0dcbc6-5d80-4d81-b00a-08ff19a2e787 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.643286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e0dcbc6-5d80-4d81-b00a-08ff19a2e787 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.644060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e0dcbc6-5d80-4d81-b00a-08ff19a2e787 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.644503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e0dcbc6-5d80-4d81-b00a-08ff19a2e787 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.697452 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-21578c7f-46ad-47bc-8ab7-38fc73369d07 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:04.697982 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-21578c7f-46ad-47bc-8ab7-38fc73369d07 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:04.703975 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-21578c7f-46ad-47bc-8ab7-38fc73369d07 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.704456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-21578c7f-46ad-47bc-8ab7-38fc73369d07 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.705213 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-21578c7f-46ad-47bc-8ab7-38fc73369d07 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.705643 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-21578c7f-46ad-47bc-8ab7-38fc73369d07 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.737966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:04.739339 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9e0dcbc6-5d80-4d81-b00a-08ff19a2e787 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/action" status: 202 len: 0 microversion: 2.20 time: 0.107009 May 26 18:21:04.741872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 207/421] 10.222.0.46 () {62 vars in 1318 bytes} [Thu May 26 18:21:04 2022] POST /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:21:04.747994 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:04.748795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:04.756042 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.756568 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.757495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.758091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.839159 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-21578c7f-46ad-47bc-8ab7-38fc73369d07 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'services' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:04.908021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:04.917413 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:04.918978 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:04.920170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-81159aec-f16e-4ed0-99b9-72446f718e0f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1751 microversion: 2.20 time: 0.176159 May 26 18:21:04.920731 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 208/422] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:04 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:04.965481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-21578c7f-46ad-47bc-8ab7-38fc73369d07 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-volume_attachments/ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1" status: 202 len: 0 microversion: 2.1 time: 0.271812 May 26 18:21:04.966192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 215/423] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:21:04 2022] DELETE /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-volume_attachments/ceb1f9c0-0576-42f8-901b-5fcfb9c5c5f1 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:21:04.975725 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-87f87882-37a2-4f04-bba2-26e61e6d06f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:04.976793 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-87f87882-37a2-4f04-bba2-26e61e6d06f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:04.983112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87f87882-37a2-4f04-bba2-26e61e6d06f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.983664 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87f87882-37a2-4f04-bba2-26e61e6d06f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:04.984771 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87f87882-37a2-4f04-bba2-26e61e6d06f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:04.985490 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87f87882-37a2-4f04-bba2-26e61e6d06f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:05.017782 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-87f87882-37a2-4f04-bba2-26e61e6d06f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 May 26 18:21:05.018424 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 209/424] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:21:04 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:21:05.941261 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:05.941997 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:05.948265 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:05.948719 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:05.949480 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:05.949962 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:06.028468 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-df147721-fe89-4d89-aeae-24e12bbf18e4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:06.029549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-df147721-fe89-4d89-aeae-24e12bbf18e4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:06.036688 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-df147721-fe89-4d89-aeae-24e12bbf18e4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:06.037143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-df147721-fe89-4d89-aeae-24e12bbf18e4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:06.038130 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-df147721-fe89-4d89-aeae-24e12bbf18e4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:06.038578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-df147721-fe89-4d89-aeae-24e12bbf18e4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:06.069534 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-df147721-fe89-4d89-aeae-24e12bbf18e4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044887 May 26 18:21:06.070377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 210/425] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:21:06 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:21:06.087992 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:06.098558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:06.100205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:06.101560 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6bfa8ef7-c46a-4565-b34e-43c4a8a70383 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1753 microversion: 2.20 time: 0.165628 May 26 18:21:06.102203 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 216/426] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:05 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:06.136698 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7815586f-2aec-4d19-bf4d-6a43e829cfbd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:06.137196 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7815586f-2aec-4d19-bf4d-6a43e829cfbd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:06.143990 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7815586f-2aec-4d19-bf4d-6a43e829cfbd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:06.144470 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7815586f-2aec-4d19-bf4d-6a43e829cfbd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:06.145487 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7815586f-2aec-4d19-bf4d-6a43e829cfbd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:06.146090 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7815586f-2aec-4d19-bf4d-6a43e829cfbd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:06.172859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7815586f-2aec-4d19-bf4d-6a43e829cfbd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:21:06.255849 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7815586f-2aec-4d19-bf4d-6a43e829cfbd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 204 len: 0 microversion: 2.1 time: 0.122700 May 26 18:21:06.256737 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 211/427] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:21:06 2022] DELETE /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:21:06.264842 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ecc03962-d2b9-46d4-8ce0-7c95ed156a0c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:06.265447 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ecc03962-d2b9-46d4-8ce0-7c95ed156a0c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:06.273819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ecc03962-d2b9-46d4-8ce0-7c95ed156a0c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:06.274494 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ecc03962-d2b9-46d4-8ce0-7c95ed156a0c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:06.275813 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ecc03962-d2b9-46d4-8ce0-7c95ed156a0c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:06.276254 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ecc03962-d2b9-46d4-8ce0-7c95ed156a0c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:06.404872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ecc03962-d2b9-46d4-8ce0-7c95ed156a0c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:06.412822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ecc03962-d2b9-46d4-8ce0-7c95ed156a0c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1681 microversion: 2.1 time: 0.151946 May 26 18:21:06.413390 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 217/428] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:06 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:07.122335 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:07.123034 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:07.131012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:07.131468 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:07.132281 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:07.132720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:07.267570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:07.276810 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:07.278351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:07.279646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-fb9e3ba4-7554-4047-ba1b-342bde81fc05 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1753 microversion: 2.20 time: 0.161732 May 26 18:21:07.280416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 212/429] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:07 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:07.430552 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-89206365-1534-406a-a647-45f110e19da9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:07.431169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-89206365-1534-406a-a647-45f110e19da9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:07.437896 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-89206365-1534-406a-a647-45f110e19da9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:07.438456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-89206365-1534-406a-a647-45f110e19da9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:07.439585 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-89206365-1534-406a-a647-45f110e19da9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:07.440674 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-89206365-1534-406a-a647-45f110e19da9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:07.575449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-89206365-1534-406a-a647-45f110e19da9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:07.583500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-89206365-1534-406a-a647-45f110e19da9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1681 microversion: 2.1 time: 0.156853 May 26 18:21:07.584080 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 218/430] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:07 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:08.298212 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:08.299365 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:08.309567 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:08.310056 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:08.310849 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:08.311291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:08.600855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-df2e49b8-2d14-411c-bf3c-d6a62cc1a3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:08.601597 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-df2e49b8-2d14-411c-bf3c-d6a62cc1a3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:08.608520 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df2e49b8-2d14-411c-bf3c-d6a62cc1a3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:08.608983 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df2e49b8-2d14-411c-bf3c-d6a62cc1a3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:08.609787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df2e49b8-2d14-411c-bf3c-d6a62cc1a3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:08.610233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df2e49b8-2d14-411c-bf3c-d6a62cc1a3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:08.710907 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:08.720416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:08.722170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:08.723333 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-45bafe3b-4b32-4ff1-8922-41bc6255ee31 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.429086 May 26 18:21:08.724128 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 213/431] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:08 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:08.995209 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-df2e49b8-2d14-411c-bf3c-d6a62cc1a3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:09.003615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-df2e49b8-2d14-411c-bf3c-d6a62cc1a3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1681 microversion: 2.1 time: 0.406637 May 26 18:21:09.004222 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 219/432] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:08 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1681 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:09.741093 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:09.742293 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:09.748974 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:09.749755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:09.750621 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:09.751138 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:09.972847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:09.983877 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:09.985480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:09.986953 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-45f66f7d-ed80-410d-b708-392b91a8515f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.249990 May 26 18:21:09.987634 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 214/433] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:09 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:10.021581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8275b24d-00ef-40bd-946a-1d19245223be tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:10.022241 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8275b24d-00ef-40bd-946a-1d19245223be tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:10.024700 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:10.034150 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8275b24d-00ef-40bd-946a-1d19245223be tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:10.034732 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8275b24d-00ef-40bd-946a-1d19245223be tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:10.035523 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8275b24d-00ef-40bd-946a-1d19245223be tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:10.035965 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8275b24d-00ef-40bd-946a-1d19245223be tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:10.085101 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-2e74d4a6-3a37-4141-96de-cf4c2484e44b req-5b2313e4-36e8-4ce4-bd88-c0c89167ce3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158ce769-fde9-413e-81f3-d76b3222b5fc", "name": "network-vif-deleted", "tag": "d8a8f1c3-9b31-4ff3-a2a8-371608a6812a"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:10.104159 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-2e74d4a6-3a37-4141-96de-cf4c2484e44b req-5b2313e4-36e8-4ce4-bd88-c0c89167ce3d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:10.104630 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-2e74d4a6-3a37-4141-96de-cf4c2484e44b req-5b2313e4-36e8-4ce4-bd88-c0c89167ce3d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:10.134947 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-2e74d4a6-3a37-4141-96de-cf4c2484e44b req-5b2313e4-36e8-4ce4-bd88-c0c89167ce3d service nova] Creating event network-vif-deleted:d8a8f1c3-9b31-4ff3-a2a8-371608a6812a for instance 158ce769-fde9-413e-81f3-d76b3222b5fc on hv-cinder-84349 May 26 18:21:10.140685 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-2e74d4a6-3a37-4141-96de-cf4c2484e44b req-5b2313e4-36e8-4ce4-bd88-c0c89167ce3d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061429 May 26 18:21:10.142166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 215/434] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:21:10.157230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8275b24d-00ef-40bd-946a-1d19245223be tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:10.168759 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8275b24d-00ef-40bd-946a-1d19245223be tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1613 microversion: 2.1 time: 0.150579 May 26 18:21:10.177553 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 220/435] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:10 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1613 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:11.006284 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:11.006984 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:11.013633 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:11.014121 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:11.014900 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:11.015368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:11.188459 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:11.189076 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:11.204055 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:11.204381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:11.204978 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:11.206010 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:11.209034 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:11.213489 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:11.216483 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:11.217914 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0070bc0e-9ac8-4e1f-86dc-169b28c732f7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.217167 May 26 18:21:11.218942 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 216/436] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:10 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:11.269815 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:11.270497 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:11.271103 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:11.329930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:11.338628 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-869a606d-f6e2-491d-a0a1-ecfa97c88d66 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.153973 May 26 18:21:11.339205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 221/437] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:11 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:12.237415 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:12.239068 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:12.246233 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:12.246690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:12.247652 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:12.248091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:12.356014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:12.356686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:12.364265 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:12.364720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:12.365499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:12.365974 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:12.399700 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:12.400163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:12.400750 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:12.404290 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:12.415998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:12.417521 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:12.418743 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ca844251-0153-4e99-803a-cea70cf7fb6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.185874 May 26 18:21:12.419310 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 217/438] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:12 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:12.456261 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:12.467021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-15d6f674-7197-4638-9fc8-278e22cf1bd7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.114738 May 26 18:21:12.469932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 222/439] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:12 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:13.438500 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:13.439201 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:13.445926 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:13.446383 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:13.447161 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:13.447618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:13.491980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:13.492720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:13.504142 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:13.504601 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:13.505398 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:13.505950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:13.543269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:13.543823 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:13.544374 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:13.602966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:13.610571 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fbac46fc-1701-438b-9059-b9856474bfc0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.122481 May 26 18:21:13.612310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 223/440] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:13 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:13.632188 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:13.640731 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:13.642291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:13.643877 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ceba1545-fe77-4f8e-9131-7be900536852 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.209336 May 26 18:21:13.647363 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 218/441] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:13 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:14.628603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:14.629136 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:14.636115 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:14.636560 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:14.637475 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:14.637954 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:14.663355 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:14.664118 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:14.671239 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:14.671798 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:14.672803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:14.673246 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:14.673743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:14.674886 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:14.675473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:14.679739 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:14.722520 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:14.730916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b4a2d887-2aaa-46f2-b194-131bdaf1373e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.106377 May 26 18:21:14.731507 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 224/442] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:14 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:14.823579 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:14.833013 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:14.834787 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:14.836282 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1a99b278-32a1-435e-ac66-6958dec98850 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.177981 May 26 18:21:14.837003 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 219/443] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:14 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:15.748658 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:15.749996 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:15.759230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:15.759683 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:15.760453 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:15.760885 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:15.793181 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:15.793623 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:15.794099 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:15.840251 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:15.858621 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:15.859308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:15.865562 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5b6cdb7f-c1d9-490d-b15a-9918d8a4de24 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.120702 May 26 18:21:15.866229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 225/444] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:15 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:15.867887 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:15.868335 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:15.869108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:15.869543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:16.003712 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:16.013015 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:16.014545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:16.015706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ffec17ee-8dce-4a93-b9e6-8c11e6451285 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.163745 May 26 18:21:16.016280 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 220/445] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:15 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:16.883014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:16.883634 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:16.890458 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:16.890998 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:16.891865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:16.892389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:16.930508 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:16.930962 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:16.931459 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:16.975916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:16.984315 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8f69d2fe-807f-4fde-a0c2-a065de60e21b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.105233 May 26 18:21:16.985235 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 226/446] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:16 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:17.035507 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:17.036435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:17.043668 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:17.044241 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:17.045195 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:17.045671 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:17.187827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:17.198541 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:17.200201 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:17.201757 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0c1c33b2-4c53-4b9f-a7ba-cb2856644b0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.170913 May 26 18:21:17.202516 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 221/447] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:17 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:18.002422 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:18.003060 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:18.009905 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:18.010364 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:18.011163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:18.011595 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:18.043224 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:18.043671 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:18.044115 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:18.086716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:18.094704 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-eaca8f71-2337-440e-9714-628f26477b62 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.096670 May 26 18:21:18.095353 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 227/448] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:17 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:18.220036 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:18.220625 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:18.227803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:18.228256 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:18.229028 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:18.229464 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:18.373291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:18.382832 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:18.384387 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:18.385589 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-65ffab21-aa95-46ba-9c45-347de193c8f0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.169457 May 26 18:21:18.386197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 222/449] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:18 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:19.113357 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:19.114221 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:19.122008 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.122464 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.123246 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.123687 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.159701 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.160231 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.160629 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:19.164354 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:19.209317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:19.217444 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4fecccff-04bc-40d1-8b01-fa4f0c2ecbad tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.108593 May 26 18:21:19.218059 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 228/450] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:19 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:19.404419 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:19.405034 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:19.412492 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.412942 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.413708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.414162 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.551571 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:19.560787 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:19.562333 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:19.563509 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6e8b2c7b-a41a-47eb-9f1a-d8aa7afc55ca tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.163016 May 26 18:21:19.564065 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 223/451] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:19 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:19.666428 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ee59f24-264b-4234-a7f8-dd5e118b517a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:19.667504 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0ee59f24-264b-4234-a7f8-dd5e118b517a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:19.675788 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ee59f24-264b-4234-a7f8-dd5e118b517a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.676243 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ee59f24-264b-4234-a7f8-dd5e118b517a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.677024 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ee59f24-264b-4234-a7f8-dd5e118b517a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.677487 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ee59f24-264b-4234-a7f8-dd5e118b517a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.751157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0ee59f24-264b-4234-a7f8-dd5e118b517a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "POST /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/action" status: 202 len: 0 microversion: 2.1 time: 0.088504 May 26 18:21:19.751789 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 229/452] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:21:19 2022] POST /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:21:19.760891 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cb5efe58-7a67-4c08-b588-a52a1c7aed4a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:19.761503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-cb5efe58-7a67-4c08-b588-a52a1c7aed4a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:19.767723 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cb5efe58-7a67-4c08-b588-a52a1c7aed4a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.768155 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cb5efe58-7a67-4c08-b588-a52a1c7aed4a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.768921 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cb5efe58-7a67-4c08-b588-a52a1c7aed4a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:19.769357 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cb5efe58-7a67-4c08-b588-a52a1c7aed4a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:19.915835 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-cb5efe58-7a67-4c08-b588-a52a1c7aed4a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:19.924571 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-cb5efe58-7a67-4c08-b588-a52a1c7aed4a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1751 microversion: 2.1 time: 0.167915 May 26 18:21:19.925086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 224/453] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:19 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:20.235241 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:20.235936 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:20.243029 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:20.243477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:20.244552 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:20.245000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:20.276881 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:20.277330 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:20.277799 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 158ce769-fde9-413e-81f3-d76b3222b5fc {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:20.323662 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:20.331364 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-883a1b9d-bff3-4463-b48f-798dcc1d5118 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 200 len: 1331 microversion: 2.1 time: 0.100286 May 26 18:21:20.332526 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 230/454] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:20 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:20.589587 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:20.590292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:20.596795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:20.597260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:20.598625 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:20.599069 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:20.737379 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:20.746756 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:20.748432 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:20.749621 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7fed0d32-6cb3-4e7e-b7bf-ca45da8d640f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.171769 May 26 18:21:20.750244 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 225/455] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:20 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:20.943843 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-573f39d5-98ef-4b2b-b67e-8742e10e613f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:20.944462 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-573f39d5-98ef-4b2b-b67e-8742e10e613f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:20.950540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-573f39d5-98ef-4b2b-b67e-8742e10e613f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:20.950984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-573f39d5-98ef-4b2b-b67e-8742e10e613f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:20.951745 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-573f39d5-98ef-4b2b-b67e-8742e10e613f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:20.952262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-573f39d5-98ef-4b2b-b67e-8742e10e613f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.097170 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-573f39d5-98ef-4b2b-b67e-8742e10e613f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:21.106557 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-573f39d5-98ef-4b2b-b67e-8742e10e613f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1751 microversion: 2.1 time: 0.166603 May 26 18:21:21.107463 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 231/456] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:20 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:21.204757 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6b4390cf-6fad-4cb2-9dd1-a9e7a5c0e757 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12317390-60a8-493f-9b29-0f6e526ce9fa"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:21.205976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6b4390cf-6fad-4cb2-9dd1-a9e7a5c0e757 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:21.212282 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6b4390cf-6fad-4cb2-9dd1-a9e7a5c0e757 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.212735 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6b4390cf-6fad-4cb2-9dd1-a9e7a5c0e757 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.213526 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6b4390cf-6fad-4cb2-9dd1-a9e7a5c0e757 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.214015 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6b4390cf-6fad-4cb2-9dd1-a9e7a5c0e757 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.349229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:21.349877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:21.356604 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.357026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.357977 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.358473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.378842 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc HTTP/1.1 May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:21:21.380710 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:21:21.382311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '158ce769-fde9-413e-81f3-d76b3222b5fc'} May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:21:21.383152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:21:21.384499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:21.386981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:21:21.388038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-50c449ff-92e3-4e66-afed-b62b9db37beb tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 404 len: 111 microversion: 2.1 time: 0.043544 May 26 18:21:21.388794 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 232/457] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:21 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:21:21.398367 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-14167722-caea-4e5d-9ea9-729b8e0a8dbe tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '.version_select at 0x7f5f1846a820>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:21.418193 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-14167722-caea-4e5d-9ea9-729b8e0a8dbe tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650672944" status: 202 len: 0 microversion: 2.1 time: 0.024717 May 26 18:21:21.418766 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 233/458] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 18:21:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650672944 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:21:21.490089 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6b4390cf-6fad-4cb2-9dd1-a9e7a5c0e757 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288979 May 26 18:21:21.490899 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 226/459] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:21:21 2022] POST /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:21:21.591874 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-60ff30e4-404c-45d8-b05b-acf4cdac763d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:21.593130 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-60ff30e4-404c-45d8-b05b-acf4cdac763d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:21.601611 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60ff30e4-404c-45d8-b05b-acf4cdac763d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.602673 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60ff30e4-404c-45d8-b05b-acf4cdac763d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.603748 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60ff30e4-404c-45d8-b05b-acf4cdac763d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.604359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-60ff30e4-404c-45d8-b05b-acf4cdac763d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.710335 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-60ff30e4-404c-45d8-b05b-acf4cdac763d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lazy-loading 'services' on Instance uuid 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:21.768598 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:21.770733 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:21.779394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.780214 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.781361 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.781967 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.799044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-60ff30e4-404c-45d8-b05b-acf4cdac763d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/os-volume_attachments/200db120-9af5-4c08-8bff-99e7e7db232c" status: 202 len: 0 microversion: 2.1 time: 0.211506 May 26 18:21:21.799928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 234/460] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:21:21 2022] DELETE /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/os-volume_attachments/200db120-9af5-4c08-8bff-99e7e7db232c => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:21:21.977418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:21.986973 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:21.989319 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:21.990598 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b1031684-3c33-469e-964c-30434d328ee2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.226199 May 26 18:21:21.991202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 227/461] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:21 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:22.125165 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6551b78a-6344-41a9-82b2-c1b751a83a06 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:22.125949 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6551b78a-6344-41a9-82b2-c1b751a83a06 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:22.132628 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6551b78a-6344-41a9-82b2-c1b751a83a06 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:22.133015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6551b78a-6344-41a9-82b2-c1b751a83a06 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:22.133821 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6551b78a-6344-41a9-82b2-c1b751a83a06 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:22.134266 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6551b78a-6344-41a9-82b2-c1b751a83a06 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:22.295430 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6551b78a-6344-41a9-82b2-c1b751a83a06 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:22.303927 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6551b78a-6344-41a9-82b2-c1b751a83a06 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.182968 May 26 18:21:22.304499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 235/462] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:22 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:22.337423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ffb3f390-9036-43ea-afaa-cd37bb614177 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: .version_select at 0x7f5f18dc74c0>, body: {"keypair": {"name": "tempest-keypair-1761058089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF94p6KBXIrvJmqh8Tv+tBmtUzB26ZpOolTLXnWTCW7KtLBKHPP92SVvn/Q745MNaaZfEkUpbgXt5S0B9A9oMtnEVCTujD80UdsAvl8aoTJ0a0SjHhLi4dRc7WrJhMYIA=="}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:22.352453 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-ffb3f390-9036-43ea-afaa-cd37bb614177 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:21:22.356260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-ffb3f390-9036-43ea-afaa-cd37bb614177 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for user 8da0a5a09a6041d68c5e445af1a492f3 and project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:21:22.377822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ffb3f390-9036-43ea-afaa-cd37bb614177 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044106 May 26 18:21:22.378440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 228/463] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:21:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:21:23.008351 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:23.008945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:23.015539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:23.015992 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:23.016761 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:23.017198 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:23.163551 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:23.174609 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:23.177076 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:23.178308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b8f7e2a8-dcb7-423f-800f-d49f2b03a84a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.173886 May 26 18:21:23.189588 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 236/464] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:23 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:23.321763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-058ea076-ab7c-4ad5-87f9-7d9fb8f99bab tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:23.322790 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-058ea076-ab7c-4ad5-87f9-7d9fb8f99bab tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:23.331253 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-058ea076-ab7c-4ad5-87f9-7d9fb8f99bab tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:23.331966 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-058ea076-ab7c-4ad5-87f9-7d9fb8f99bab tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:23.332964 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-058ea076-ab7c-4ad5-87f9-7d9fb8f99bab tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:23.333472 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-058ea076-ab7c-4ad5-87f9-7d9fb8f99bab tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:23.476547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-058ea076-ab7c-4ad5-87f9-7d9fb8f99bab tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:23.484922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-058ea076-ab7c-4ad5-87f9-7d9fb8f99bab tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.167694 May 26 18:21:23.485529 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 229/465] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:23 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:23.688508 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1193032010", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a9ad5fd-79c8-4cd5-b5bd-a36ef382cf69"}], "security_groups": [{"name": "tempest-securitygroup--1215856095"}], "key_name": "tempest-keypair-1761058089", "user_data": "}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:23.790502 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] validate_networks() for [('8a9ad5fd-79c8-4cd5-b5bd-a36ef382cf69', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:21:24.149242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:21:24.149847 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:21:24.150268 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:21:24.150706 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:21:24.151103 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:21:24.161260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:24.161708 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:24.162539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:24.162979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:24.180298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:21:24.184258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for user 8da0a5a09a6041d68c5e445af1a492f3 and project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:21:24.195635 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:21:24.196795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:24.197399 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:24.197933 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:21:24.203433 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:24.203875 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:24.204625 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:24.205053 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:24.248211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-01152fc7-9978-4a42-8d4e-59fbd20d5a44 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563804 May 26 18:21:24.248950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 237/466] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:21:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:21:24.258985 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1022a9d7-bf10-46a8-a1b9-f8e66dc4ac2b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:24.259597 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1022a9d7-bf10-46a8-a1b9-f8e66dc4ac2b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:24.332980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1022a9d7-bf10-46a8-a1b9-f8e66dc4ac2b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:24.339703 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1022a9d7-bf10-46a8-a1b9-f8e66dc4ac2b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1242 microversion: 2.1 time: 0.084750 May 26 18:21:24.340485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 238/467] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:24 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:24.363142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:24.371747 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:24.373318 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:24.374522 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2b96713b-f0a5-42c3-b953-85fcc2f61c5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.181735 May 26 18:21:24.375078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 230/468] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:24 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:24.503395 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c0fdeeb0-3bb7-4eb2-80ad-95ee8cf3975d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:24.504300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c0fdeeb0-3bb7-4eb2-80ad-95ee8cf3975d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:24.512778 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0fdeeb0-3bb7-4eb2-80ad-95ee8cf3975d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:24.513376 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0fdeeb0-3bb7-4eb2-80ad-95ee8cf3975d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:24.514213 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0fdeeb0-3bb7-4eb2-80ad-95ee8cf3975d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:24.514791 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0fdeeb0-3bb7-4eb2-80ad-95ee8cf3975d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:24.664250 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c0fdeeb0-3bb7-4eb2-80ad-95ee8cf3975d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:24.672862 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c0fdeeb0-3bb7-4eb2-80ad-95ee8cf3975d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.173829 May 26 18:21:24.673539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 239/469] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:24 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:25.360027 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6839dd0b-453f-4f05-b2d1-953c0169a8f0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:25.361372 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6839dd0b-453f-4f05-b2d1-953c0169a8f0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:25.372635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6839dd0b-453f-4f05-b2d1-953c0169a8f0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:25.373455 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6839dd0b-453f-4f05-b2d1-953c0169a8f0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:25.374907 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6839dd0b-453f-4f05-b2d1-953c0169a8f0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:25.375661 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6839dd0b-453f-4f05-b2d1-953c0169a8f0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:25.392570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:25.393353 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:25.400618 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:25.401149 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:25.402456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:25.402456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:25.503980 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6839dd0b-453f-4f05-b2d1-953c0169a8f0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:25.512030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6839dd0b-453f-4f05-b2d1-953c0169a8f0 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1300 microversion: 2.1 time: 0.158773 May 26 18:21:25.512609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 231/470] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:25 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1300 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:25.602872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:25.611954 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:25.613455 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:25.614678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5117af07-3c34-431c-b57b-0fae9f41b0d4 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.226186 May 26 18:21:25.616069 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 240/471] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:25 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:25.693531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8376cc34-58aa-447a-9804-2e7c5e731256 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:25.694281 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8376cc34-58aa-447a-9804-2e7c5e731256 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:25.700314 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8376cc34-58aa-447a-9804-2e7c5e731256 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:25.700904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8376cc34-58aa-447a-9804-2e7c5e731256 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:25.701674 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8376cc34-58aa-447a-9804-2e7c5e731256 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:25.702443 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8376cc34-58aa-447a-9804-2e7c5e731256 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:25.926071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8376cc34-58aa-447a-9804-2e7c5e731256 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:25.934975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8376cc34-58aa-447a-9804-2e7c5e731256 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.245370 May 26 18:21:25.935551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 232/472] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:25 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:26.529359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-08200972-fc28-4289-a3cd-f2be6d683547 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:26.530341 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-08200972-fc28-4289-a3cd-f2be6d683547 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:26.536811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-08200972-fc28-4289-a3cd-f2be6d683547 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:26.537266 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-08200972-fc28-4289-a3cd-f2be6d683547 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:26.538065 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-08200972-fc28-4289-a3cd-f2be6d683547 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:26.539000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-08200972-fc28-4289-a3cd-f2be6d683547 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:26.634360 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:26.634965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:26.642261 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:26.642708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:26.643478 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:26.643907 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:26.797644 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-08200972-fc28-4289-a3cd-f2be6d683547 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:26.813666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-08200972-fc28-4289-a3cd-f2be6d683547 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1368 microversion: 2.1 time: 0.288019 May 26 18:21:26.814651 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 241/473] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:26 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:26.908709 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:26.918591 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:26.920066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:26.921439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4301ba8c-faa9-4528-ac72-5590cc7a3f01 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.291487 May 26 18:21:26.922555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 233/474] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:26 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:26.952369 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-55ac6341-afbe-46c3-890a-f1048f9a4701 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:26.953009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-55ac6341-afbe-46c3-890a-f1048f9a4701 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:26.959460 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-55ac6341-afbe-46c3-890a-f1048f9a4701 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:26.959931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-55ac6341-afbe-46c3-890a-f1048f9a4701 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:26.961442 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-55ac6341-afbe-46c3-890a-f1048f9a4701 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:26.961912 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-55ac6341-afbe-46c3-890a-f1048f9a4701 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:27.123854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-4398a3a2-7291-4795-a43f-4311e4a17b84 req-3c65b62a-a378-4e70-8cd6-509c98ed09ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e1d369-3bad-49f8-8830-1f1206e60780", "tag": "2fbeda35-35e5-4278-a0b7-b2cfe145869c"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:27.133454 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-4398a3a2-7291-4795-a43f-4311e4a17b84 req-3c65b62a-a378-4e70-8cd6-509c98ed09ea service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:27.134216 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-4398a3a2-7291-4795-a43f-4311e4a17b84 req-3c65b62a-a378-4e70-8cd6-509c98ed09ea service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:27.145896 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-4398a3a2-7291-4795-a43f-4311e4a17b84 req-3c65b62a-a378-4e70-8cd6-509c98ed09ea service nova] Creating event network-changed:2fbeda35-35e5-4278-a0b7-b2cfe145869c for instance f5e1d369-3bad-49f8-8830-1f1206e60780 on hv-cinder-84349 May 26 18:21:27.154824 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-4398a3a2-7291-4795-a43f-4311e4a17b84 req-3c65b62a-a378-4e70-8cd6-509c98ed09ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034491 May 26 18:21:27.155614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 234/475] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:21:27.259485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-55ac6341-afbe-46c3-890a-f1048f9a4701 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:27.268278 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-55ac6341-afbe-46c3-890a-f1048f9a4701 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.319718 May 26 18:21:27.268857 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 242/476] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:26 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:27.831605 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-af37cbfd-8b85-4b4a-a21b-78a72f2c3a47 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:27.832395 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-af37cbfd-8b85-4b4a-a21b-78a72f2c3a47 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:27.838599 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af37cbfd-8b85-4b4a-a21b-78a72f2c3a47 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:27.839050 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af37cbfd-8b85-4b4a-a21b-78a72f2c3a47 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:27.839808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af37cbfd-8b85-4b4a-a21b-78a72f2c3a47 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:27.840245 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af37cbfd-8b85-4b4a-a21b-78a72f2c3a47 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:27.947455 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:27.948139 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:27.954555 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:27.955073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:27.955909 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:27.956425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:27.975204 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-af37cbfd-8b85-4b4a-a21b-78a72f2c3a47 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:27.983236 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-af37cbfd-8b85-4b4a-a21b-78a72f2c3a47 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1368 microversion: 2.1 time: 0.156289 May 26 18:21:27.983820 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 235/477] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:27 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:28.089386 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:28.098011 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:28.099578 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:28.100842 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4094bcf9-d4d2-4b54-bb78-a290195e88d5 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.157481 May 26 18:21:28.102009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 243/478] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:27 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:28.285172 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5c34cc23-13d3-42c1-a16c-c8615536b84d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:28.285825 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-5c34cc23-13d3-42c1-a16c-c8615536b84d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:28.292225 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5c34cc23-13d3-42c1-a16c-c8615536b84d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:28.292702 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5c34cc23-13d3-42c1-a16c-c8615536b84d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:28.293503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5c34cc23-13d3-42c1-a16c-c8615536b84d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:28.294040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5c34cc23-13d3-42c1-a16c-c8615536b84d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:28.296683 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:28.443540 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-5c34cc23-13d3-42c1-a16c-c8615536b84d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:28.451625 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5c34cc23-13d3-42c1-a16c-c8615536b84d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.170304 May 26 18:21:28.452202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 236/479] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:28 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:29.000094 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a6579dd0-050e-4f87-a6e6-2bc39a61bc4e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:29.000741 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a6579dd0-050e-4f87-a6e6-2bc39a61bc4e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:29.007516 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6579dd0-050e-4f87-a6e6-2bc39a61bc4e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.007981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6579dd0-050e-4f87-a6e6-2bc39a61bc4e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.008754 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6579dd0-050e-4f87-a6e6-2bc39a61bc4e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.009198 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a6579dd0-050e-4f87-a6e6-2bc39a61bc4e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.041481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f38c368d-a6fc-46f3-ba2c-a3902ff26913 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:29.044143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f38c368d-a6fc-46f3-ba2c-a3902ff26913 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:29.049184 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f38c368d-a6fc-46f3-ba2c-a3902ff26913 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.049635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f38c368d-a6fc-46f3-ba2c-a3902ff26913 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.050430 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f38c368d-a6fc-46f3-ba2c-a3902ff26913 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.050859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f38c368d-a6fc-46f3-ba2c-a3902ff26913 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.075905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-f38c368d-a6fc-46f3-ba2c-a3902ff26913 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lazy-loading 'flavor' on Instance uuid 97dd8752-9cc1-438c-830c-4f34e8c05fd6 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:21:29.148763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a6579dd0-050e-4f87-a6e6-2bc39a61bc4e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:29.156682 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a6579dd0-050e-4f87-a6e6-2bc39a61bc4e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1368 microversion: 2.1 time: 0.160229 May 26 18:21:29.157474 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 244/480] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:28 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:29.162342 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:29.162949 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:29.169450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.169956 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.170731 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.171170 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.208771 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f38c368d-a6fc-46f3-ba2c-a3902ff26913 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/action" status: 200 len: 32 microversion: 2.1 time: 0.172191 May 26 18:21:29.209697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 237/481] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:21:29 2022] POST /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:21:29.219699 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-53df0eae-8227-4276-a216-6975df02256a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:29.220393 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-53df0eae-8227-4276-a216-6975df02256a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:29.227388 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-53df0eae-8227-4276-a216-6975df02256a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.228103 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-53df0eae-8227-4276-a216-6975df02256a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.228876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-53df0eae-8227-4276-a216-6975df02256a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.229313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-53df0eae-8227-4276-a216-6975df02256a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.376908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:29.389402 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:29.391176 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:29.392505 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b206fa4d-4327-42d9-b682-8c7c43f7c5e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.234028 May 26 18:21:29.393617 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 245/482] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:29 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:29.446786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-53df0eae-8227-4276-a216-6975df02256a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:29.455611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-53df0eae-8227-4276-a216-6975df02256a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.239958 May 26 18:21:29.456227 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 238/483] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:29 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:29.468404 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2d36ac84-26a2-48e4-b400-74be538faecc tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:29.469127 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2d36ac84-26a2-48e4-b400-74be538faecc tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:29.475250 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d36ac84-26a2-48e4-b400-74be538faecc tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.476396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d36ac84-26a2-48e4-b400-74be538faecc tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.477354 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d36ac84-26a2-48e4-b400-74be538faecc tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:29.478016 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d36ac84-26a2-48e4-b400-74be538faecc tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.498340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:30.081531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2d36ac84-26a2-48e4-b400-74be538faecc tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:30.090693 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2d36ac84-26a2-48e4-b400-74be538faecc tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.626225 May 26 18:21:30.091269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 246/484] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:29 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:30.175495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e7a87380-8176-46bf-b6c4-a7d7601e89fa tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:30.176230 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e7a87380-8176-46bf-b6c4-a7d7601e89fa tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:30.183425 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e7a87380-8176-46bf-b6c4-a7d7601e89fa tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.183871 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e7a87380-8176-46bf-b6c4-a7d7601e89fa tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.184640 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e7a87380-8176-46bf-b6c4-a7d7601e89fa tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.185069 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e7a87380-8176-46bf-b6c4-a7d7601e89fa tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.394177 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f45eaf90-a14b-4ff9-846b-f2bcdfc22c51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:30.400713 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f45eaf90-a14b-4ff9-846b-f2bcdfc22c51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.401163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f45eaf90-a14b-4ff9-846b-f2bcdfc22c51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.458420 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e7a87380-8176-46bf-b6c4-a7d7601e89fa tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:30.463734 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f45eaf90-a14b-4ff9-846b-f2bcdfc22c51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Going to try to stop instance {{(pid=117696) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 18:21:30.467503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e7a87380-8176-46bf-b6c4-a7d7601e89fa tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1368 microversion: 2.1 time: 0.296062 May 26 18:21:30.473411 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 239/485] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:30 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:30.473411 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:30.474048 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:30.480655 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.481186 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.482049 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.482555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.522230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f45eaf90-a14b-4ff9-846b-f2bcdfc22c51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/action" status: 202 len: 0 microversion: 2.1 time: 0.131575 May 26 18:21:30.523901 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 247/486] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:21:30 2022] POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:21:30.529892 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fe734c50-4b53-43c5-8077-3760a76d7ae9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:30.530606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fe734c50-4b53-43c5-8077-3760a76d7ae9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:30.536997 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fe734c50-4b53-43c5-8077-3760a76d7ae9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.537486 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fe734c50-4b53-43c5-8077-3760a76d7ae9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.539354 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fe734c50-4b53-43c5-8077-3760a76d7ae9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.539877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fe734c50-4b53-43c5-8077-3760a76d7ae9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.785546 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:30.794516 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:30.796013 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:30.797194 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-29c07655-57c5-44ff-b49b-9e668ee7de02 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.327806 May 26 18:21:30.797324 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fe734c50-4b53-43c5-8077-3760a76d7ae9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:30.797980 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 240/487] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:30 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:30.803892 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-27059186-e032-4a0d-ac3c-9cd7eff46369 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:30.804513 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-27059186-e032-4a0d-ac3c-9cd7eff46369 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:30.810633 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-27059186-e032-4a0d-ac3c-9cd7eff46369 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.811088 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-27059186-e032-4a0d-ac3c-9cd7eff46369 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.811865 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-27059186-e032-4a0d-ac3c-9cd7eff46369 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.812307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-27059186-e032-4a0d-ac3c-9cd7eff46369 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.817051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fe734c50-4b53-43c5-8077-3760a76d7ae9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.291598 May 26 18:21:30.817777 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 248/488] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:30 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:30.959884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-27059186-e032-4a0d-ac3c-9cd7eff46369 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:30.968087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-27059186-e032-4a0d-ac3c-9cd7eff46369 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.167859 May 26 18:21:30.968661 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 241/489] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:30 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:31.109376 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fd176307-a095-4b62-91d0-9c7610a8028c tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:31.109942 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fd176307-a095-4b62-91d0-9c7610a8028c tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:31.117223 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd176307-a095-4b62-91d0-9c7610a8028c tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.117675 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd176307-a095-4b62-91d0-9c7610a8028c tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.118473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd176307-a095-4b62-91d0-9c7610a8028c tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.118913 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fd176307-a095-4b62-91d0-9c7610a8028c tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.265309 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fd176307-a095-4b62-91d0-9c7610a8028c tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:31.273530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fd176307-a095-4b62-91d0-9c7610a8028c tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.168165 May 26 18:21:31.274176 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 249/490] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:31 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:31.484744 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8a65678b-2a53-4c87-828b-0a660b51256e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:31.485335 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8a65678b-2a53-4c87-828b-0a660b51256e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:31.492703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8a65678b-2a53-4c87-828b-0a660b51256e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.493148 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8a65678b-2a53-4c87-828b-0a660b51256e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.493934 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8a65678b-2a53-4c87-828b-0a660b51256e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.497595 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-510e40db-5d59-46e7-8969-6aa896025c76 req-c2e12c5f-1f5c-4e71-9239-ae30c06989fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0eeeed-f9b7-4526-bd2f-ac98a769fd80", "name": "network-vif-plugged", "status": "completed", "tag": "1d3fd217-af97-47a7-9225-e698208d450f"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:31.497789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8a65678b-2a53-4c87-828b-0a660b51256e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.504738 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-510e40db-5d59-46e7-8969-6aa896025c76 req-c2e12c5f-1f5c-4e71-9239-ae30c06989fd service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.505381 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-510e40db-5d59-46e7-8969-6aa896025c76 req-c2e12c5f-1f5c-4e71-9239-ae30c06989fd service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.518062 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-510e40db-5d59-46e7-8969-6aa896025c76 req-c2e12c5f-1f5c-4e71-9239-ae30c06989fd service nova] Creating event network-vif-plugged:1d3fd217-af97-47a7-9225-e698208d450f for instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 on hv-cinder-84349 May 26 18:21:31.525526 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-510e40db-5d59-46e7-8969-6aa896025c76 req-c2e12c5f-1f5c-4e71-9239-ae30c06989fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034836 May 26 18:21:31.526879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 250/491] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:21:31.646538 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8a65678b-2a53-4c87-828b-0a660b51256e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:31.654086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8a65678b-2a53-4c87-828b-0a660b51256e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1368 microversion: 2.1 time: 0.173262 May 26 18:21:31.654657 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 242/492] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:31 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:31.816232 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:31.816966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:31.818961 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:31.824731 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.825185 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.826018 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.826431 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.836430 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f6b105e8-ce54-4bd0-be8b-09d81489aaca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:31.837038 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f6b105e8-ce54-4bd0-be8b-09d81489aaca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:31.843116 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f6b105e8-ce54-4bd0-be8b-09d81489aaca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.843561 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f6b105e8-ce54-4bd0-be8b-09d81489aaca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.844320 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f6b105e8-ce54-4bd0-be8b-09d81489aaca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.844750 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f6b105e8-ce54-4bd0-be8b-09d81489aaca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.029117 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:32.047689 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f6b105e8-ce54-4bd0-be8b-09d81489aaca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:32.057067 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f6b105e8-ce54-4bd0-be8b-09d81489aaca tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.225357 May 26 18:21:32.057341 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:32.057937 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 243/493] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:31 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:32.058918 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:32.060098 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a96cfce6-33fb-49e1-9dc0-752cbb94c1ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.248386 May 26 18:21:32.069776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 251/494] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:31 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:32.069992 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f91ea3e7-013a-4224-ab00-83938dc5eb51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:32.069992 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f91ea3e7-013a-4224-ab00-83938dc5eb51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:32.069992 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:32.072549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f91ea3e7-013a-4224-ab00-83938dc5eb51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:32.073475 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f91ea3e7-013a-4224-ab00-83938dc5eb51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.075061 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f91ea3e7-013a-4224-ab00-83938dc5eb51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:32.075936 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f91ea3e7-013a-4224-ab00-83938dc5eb51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.276771 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f91ea3e7-013a-4224-ab00-83938dc5eb51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:32.284480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f91ea3e7-013a-4224-ab00-83938dc5eb51 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.225284 May 26 18:21:32.285848 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 244/495] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:32 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:32.295937 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9ccd7fad-2f27-4e39-b778-72ab17dd195a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:32.297309 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9ccd7fad-2f27-4e39-b778-72ab17dd195a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:32.304139 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ccd7fad-2f27-4e39-b778-72ab17dd195a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:32.304588 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ccd7fad-2f27-4e39-b778-72ab17dd195a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.305486 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ccd7fad-2f27-4e39-b778-72ab17dd195a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:32.305941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ccd7fad-2f27-4e39-b778-72ab17dd195a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.472499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9ccd7fad-2f27-4e39-b778-72ab17dd195a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:32.481490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9ccd7fad-2f27-4e39-b778-72ab17dd195a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.189522 May 26 18:21:32.482121 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 252/496] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:32 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:32.673455 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bd004a7f-9c22-4ba6-ac41-5d38c83a724d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:32.674359 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-bd004a7f-9c22-4ba6-ac41-5d38c83a724d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:32.676393 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=4 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:32.685017 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bd004a7f-9c22-4ba6-ac41-5d38c83a724d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:32.685597 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bd004a7f-9c22-4ba6-ac41-5d38c83a724d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.686883 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bd004a7f-9c22-4ba6-ac41-5d38c83a724d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:32.687051 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bd004a7f-9c22-4ba6-ac41-5d38c83a724d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.853483 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bd004a7f-9c22-4ba6-ac41-5d38c83a724d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:32.862335 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-bd004a7f-9c22-4ba6-ac41-5d38c83a724d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1368 microversion: 2.1 time: 0.194882 May 26 18:21:32.862918 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 245/497] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:32 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:33.075866 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-31b8c699-695e-4e31-bf61-39986e84ea6f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:33.076396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-31b8c699-695e-4e31-bf61-39986e84ea6f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:33.079375 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:33.079988 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:33.082504 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-31b8c699-695e-4e31-bf61-39986e84ea6f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.082962 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-31b8c699-695e-4e31-bf61-39986e84ea6f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.083732 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-31b8c699-695e-4e31-bf61-39986e84ea6f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.084173 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-31b8c699-695e-4e31-bf61-39986e84ea6f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.085925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.086377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.087132 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.087596 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.325585 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-31b8c699-695e-4e31-bf61-39986e84ea6f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:33.335477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-31b8c699-695e-4e31-bf61-39986e84ea6f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.263117 May 26 18:21:33.338296 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:33.341793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 253/498] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:33 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:33.351032 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b9ee7608-2b13-4ab2-a703-3c9b8762cc6e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:33.351032 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b9ee7608-2b13-4ab2-a703-3c9b8762cc6e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:33.354908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b9ee7608-2b13-4ab2-a703-3c9b8762cc6e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.355473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b9ee7608-2b13-4ab2-a703-3c9b8762cc6e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.356326 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b9ee7608-2b13-4ab2-a703-3c9b8762cc6e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.356931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b9ee7608-2b13-4ab2-a703-3c9b8762cc6e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.357039 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:33.359004 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:33.360502 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ac1d4554-2453-443b-bf05-fde7800ed04a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.284971 May 26 18:21:33.361637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 246/499] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:33 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:33.488535 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b9ee7608-2b13-4ab2-a703-3c9b8762cc6e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:33.497070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b9ee7608-2b13-4ab2-a703-3c9b8762cc6e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.153388 May 26 18:21:33.497647 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 254/500] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:33 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:33.500307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a0ce69d8-837b-427e-8052-ad83e06a400b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:33.501059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a0ce69d8-837b-427e-8052-ad83e06a400b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:33.507818 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a0ce69d8-837b-427e-8052-ad83e06a400b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.508267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a0ce69d8-837b-427e-8052-ad83e06a400b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.509020 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a0ce69d8-837b-427e-8052-ad83e06a400b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.509450 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a0ce69d8-837b-427e-8052-ad83e06a400b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.539631 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-f5d71c9f-d093-4b6a-9141-12fea772e5c1 req-56c10048-c24c-4723-a50f-5b18230df2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e1d369-3bad-49f8-8830-1f1206e60780", "name": "network-vif-plugged", "status": "completed", "tag": "2fbeda35-35e5-4278-a0b7-b2cfe145869c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:33.548266 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-f5d71c9f-d093-4b6a-9141-12fea772e5c1 req-56c10048-c24c-4723-a50f-5b18230df2be service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.548707 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-f5d71c9f-d093-4b6a-9141-12fea772e5c1 req-56c10048-c24c-4723-a50f-5b18230df2be service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.563247 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-f5d71c9f-d093-4b6a-9141-12fea772e5c1 req-56c10048-c24c-4723-a50f-5b18230df2be service nova] Creating event network-vif-plugged:2fbeda35-35e5-4278-a0b7-b2cfe145869c for instance f5e1d369-3bad-49f8-8830-1f1206e60780 on hv-cinder-84349 May 26 18:21:33.568356 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-f5d71c9f-d093-4b6a-9141-12fea772e5c1 req-56c10048-c24c-4723-a50f-5b18230df2be service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032260 May 26 18:21:33.568964 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 255/501] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:21:33.655260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a0ce69d8-837b-427e-8052-ad83e06a400b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:33.663232 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a0ce69d8-837b-427e-8052-ad83e06a400b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.166756 May 26 18:21:33.664314 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 247/502] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:33 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:33.883341 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4e85864c-5573-4bb3-93a8-2f5838f6dfa9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:33.883963 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4e85864c-5573-4bb3-93a8-2f5838f6dfa9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:33.890372 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4e85864c-5573-4bb3-93a8-2f5838f6dfa9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.890825 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4e85864c-5573-4bb3-93a8-2f5838f6dfa9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.891587 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4e85864c-5573-4bb3-93a8-2f5838f6dfa9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.892025 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4e85864c-5573-4bb3-93a8-2f5838f6dfa9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.025010 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4e85864c-5573-4bb3-93a8-2f5838f6dfa9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:34.032360 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4e85864c-5573-4bb3-93a8-2f5838f6dfa9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1368 microversion: 2.1 time: 0.153446 May 26 18:21:34.032924 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 256/503] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:33 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:34.358487 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-875c8eb3-5148-4bea-b88b-17d7885952bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:34.359173 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-875c8eb3-5148-4bea-b88b-17d7885952bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:34.365660 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-875c8eb3-5148-4bea-b88b-17d7885952bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:34.366295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-875c8eb3-5148-4bea-b88b-17d7885952bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.367406 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-875c8eb3-5148-4bea-b88b-17d7885952bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:34.367844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-875c8eb3-5148-4bea-b88b-17d7885952bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.380096 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:34.380898 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:34.384138 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:34.385819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=8 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:34.392516 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:34.393313 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.394195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:34.394815 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.581898 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-875c8eb3-5148-4bea-b88b-17d7885952bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:34.593616 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-875c8eb3-5148-4bea-b88b-17d7885952bd tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.238819 May 26 18:21:34.594418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 248/504] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:34 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:34.595235 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:34.599586 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a5c81625-3c9c-4d3e-88d7-946a16522cb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:34.600307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a5c81625-3c9c-4d3e-88d7-946a16522cb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:34.605622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:34.607529 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:34.608709 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c78c2879-7052-44a9-9ccd-a4185637f868 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1809 microversion: 2.20 time: 0.232904 May 26 18:21:34.609267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 257/505] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:34 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:21:34.610336 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a5c81625-3c9c-4d3e-88d7-946a16522cb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:34.610990 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a5c81625-3c9c-4d3e-88d7-946a16522cb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.611950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a5c81625-3c9c-4d3e-88d7-946a16522cb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:34.612762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a5c81625-3c9c-4d3e-88d7-946a16522cb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.681776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d49e44a1-e168-4a81-a248-4c9782dc4309 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:34.682811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d49e44a1-e168-4a81-a248-4c9782dc4309 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:34.689014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d49e44a1-e168-4a81-a248-4c9782dc4309 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:34.689519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d49e44a1-e168-4a81-a248-4c9782dc4309 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.690330 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d49e44a1-e168-4a81-a248-4c9782dc4309 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:34.690765 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d49e44a1-e168-4a81-a248-4c9782dc4309 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:34.778562 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a5c81625-3c9c-4d3e-88d7-946a16522cb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:34.786167 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a5c81625-3c9c-4d3e-88d7-946a16522cb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.190524 May 26 18:21:34.786742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 249/506] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:34 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:34.850739 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d49e44a1-e168-4a81-a248-4c9782dc4309 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:34.859396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d49e44a1-e168-4a81-a248-4c9782dc4309 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.182279 May 26 18:21:34.859970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 258/507] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:34 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:35.051551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c1a26395-ff0a-422a-ab71-81d14070c7ef tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:35.052395 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c1a26395-ff0a-422a-ab71-81d14070c7ef tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:35.058472 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c1a26395-ff0a-422a-ab71-81d14070c7ef tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.058920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c1a26395-ff0a-422a-ab71-81d14070c7ef tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.059684 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c1a26395-ff0a-422a-ab71-81d14070c7ef tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.060116 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c1a26395-ff0a-422a-ab71-81d14070c7ef tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.198179 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c1a26395-ff0a-422a-ab71-81d14070c7ef tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:35.201271 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:35.207034 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c1a26395-ff0a-422a-ab71-81d14070c7ef tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1368 microversion: 2.1 time: 0.160305 May 26 18:21:35.207607 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 250/508] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:35 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:35.611499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5b8426d9-0643-47a1-8d5c-007dd55145d4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:35.612049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5b8426d9-0643-47a1-8d5c-007dd55145d4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:35.619650 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b8426d9-0643-47a1-8d5c-007dd55145d4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.620107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b8426d9-0643-47a1-8d5c-007dd55145d4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.620913 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b8426d9-0643-47a1-8d5c-007dd55145d4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.621355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5b8426d9-0643-47a1-8d5c-007dd55145d4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.628271 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:35.628882 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:35.637251 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.637704 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.638505 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.638940 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.810436 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5b8426d9-0643-47a1-8d5c-007dd55145d4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:35.818324 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5b8426d9-0643-47a1-8d5c-007dd55145d4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.210838 May 26 18:21:35.818903 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 259/509] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:35 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:35.823944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-07adf3fe-a357-4d6d-9417-9c5c11be96b1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:35.824556 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-07adf3fe-a357-4d6d-9417-9c5c11be96b1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:35.826460 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:35.830760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07adf3fe-a357-4d6d-9417-9c5c11be96b1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.831213 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07adf3fe-a357-4d6d-9417-9c5c11be96b1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.831986 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07adf3fe-a357-4d6d-9417-9c5c11be96b1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.832430 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07adf3fe-a357-4d6d-9417-9c5c11be96b1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.836315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:35.838251 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:35.839828 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f089577b-7936-49ae-bba3-78022ed86743 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1796 microversion: 2.20 time: 0.215533 May 26 18:21:35.845585 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 251/510] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:21:35 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1796 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:21:35.931620 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6fdd27fb-e90b-49af-9798-795dba7eef2d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:35.932240 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6fdd27fb-e90b-49af-9798-795dba7eef2d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:35.938457 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6fdd27fb-e90b-49af-9798-795dba7eef2d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.938907 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6fdd27fb-e90b-49af-9798-795dba7eef2d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.939688 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6fdd27fb-e90b-49af-9798-795dba7eef2d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:35.940126 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6fdd27fb-e90b-49af-9798-795dba7eef2d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:35.973001 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-07adf3fe-a357-4d6d-9417-9c5c11be96b1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:35.981958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-07adf3fe-a357-4d6d-9417-9c5c11be96b1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.162033 May 26 18:21:35.982665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 260/511] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:35 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:36.083455 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6fdd27fb-e90b-49af-9798-795dba7eef2d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:36.091854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6fdd27fb-e90b-49af-9798-795dba7eef2d tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.164655 May 26 18:21:36.092416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 252/512] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:35 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:36.224368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-381ad0b0-c48d-4af2-b266-b781325cc7f4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:36.224915 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-381ad0b0-c48d-4af2-b266-b781325cc7f4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:36.231802 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-381ad0b0-c48d-4af2-b266-b781325cc7f4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:36.232260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-381ad0b0-c48d-4af2-b266-b781325cc7f4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:36.233034 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-381ad0b0-c48d-4af2-b266-b781325cc7f4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:36.233480 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-381ad0b0-c48d-4af2-b266-b781325cc7f4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:36.365068 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-381ad0b0-c48d-4af2-b266-b781325cc7f4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:36.373060 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-381ad0b0-c48d-4af2-b266-b781325cc7f4 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1558 microversion: 2.1 time: 0.152624 May 26 18:21:36.373619 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 261/513] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:36 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:36.389202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9763eb09-75a0-403b-bd18-70dba3d726c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:36.389692 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9763eb09-75a0-403b-bd18-70dba3d726c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:36.395651 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9763eb09-75a0-403b-bd18-70dba3d726c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:36.396107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9763eb09-75a0-403b-bd18-70dba3d726c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:36.396867 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9763eb09-75a0-403b-bd18-70dba3d726c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:36.397304 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9763eb09-75a0-403b-bd18-70dba3d726c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:36.472135 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9763eb09-75a0-403b-bd18-70dba3d726c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086808 May 26 18:21:36.472732 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 253/514] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 18:21:36 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:21:36.836683 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5615d5b7-a75a-42f1-b5bb-7aa20aed99a7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:36.837233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5615d5b7-a75a-42f1-b5bb-7aa20aed99a7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:36.844028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5615d5b7-a75a-42f1-b5bb-7aa20aed99a7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:36.844496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5615d5b7-a75a-42f1-b5bb-7aa20aed99a7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:36.845284 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5615d5b7-a75a-42f1-b5bb-7aa20aed99a7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:36.845746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5615d5b7-a75a-42f1-b5bb-7aa20aed99a7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:37.004348 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7ffbda5c-2c2b-4bcb-971d-58463858a697 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:37.004965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7ffbda5c-2c2b-4bcb-971d-58463858a697 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:37.011040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7ffbda5c-2c2b-4bcb-971d-58463858a697 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:37.011498 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7ffbda5c-2c2b-4bcb-971d-58463858a697 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:37.012264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7ffbda5c-2c2b-4bcb-971d-58463858a697 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:37.012705 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7ffbda5c-2c2b-4bcb-971d-58463858a697 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:37.207319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5615d5b7-a75a-42f1-b5bb-7aa20aed99a7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:37.216612 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5615d5b7-a75a-42f1-b5bb-7aa20aed99a7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.384054 May 26 18:21:37.227145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 262/515] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:36 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:37.227145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-50a3d955-c2ca-4b9b-be04-9a87c2c5df63 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:37.227145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-50a3d955-c2ca-4b9b-be04-9a87c2c5df63 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:37.231510 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50a3d955-c2ca-4b9b-be04-9a87c2c5df63 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:37.232037 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50a3d955-c2ca-4b9b-be04-9a87c2c5df63 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:37.232869 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50a3d955-c2ca-4b9b-be04-9a87c2c5df63 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:37.233371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50a3d955-c2ca-4b9b-be04-9a87c2c5df63 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:37.252574 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:37.327038 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7ffbda5c-2c2b-4bcb-971d-58463858a697 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:37.335324 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7ffbda5c-2c2b-4bcb-971d-58463858a697 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.335336 May 26 18:21:37.346365 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 254/516] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:36 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:37.500985 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-50a3d955-c2ca-4b9b-be04-9a87c2c5df63 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:37.510204 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-50a3d955-c2ca-4b9b-be04-9a87c2c5df63 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1756 microversion: 2.1 time: 0.291142 May 26 18:21:37.510900 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 263/517] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:37 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1756 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:37.867289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-f558bf0a-a58a-4df7-8768-d11664628fd4 req-57983d70-c0e5-48d7-9ca5-f38cdf20e01c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e1d369-3bad-49f8-8830-1f1206e60780", "tag": "2fbeda35-35e5-4278-a0b7-b2cfe145869c"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:37.875532 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-f558bf0a-a58a-4df7-8768-d11664628fd4 req-57983d70-c0e5-48d7-9ca5-f38cdf20e01c service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:37.875984 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-f558bf0a-a58a-4df7-8768-d11664628fd4 req-57983d70-c0e5-48d7-9ca5-f38cdf20e01c service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:37.886762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-f558bf0a-a58a-4df7-8768-d11664628fd4 req-57983d70-c0e5-48d7-9ca5-f38cdf20e01c service nova] Creating event network-changed:2fbeda35-35e5-4278-a0b7-b2cfe145869c for instance f5e1d369-3bad-49f8-8830-1f1206e60780 on hv-cinder-84349 May 26 18:21:37.891967 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-f558bf0a-a58a-4df7-8768-d11664628fd4 req-57983d70-c0e5-48d7-9ca5-f38cdf20e01c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028978 May 26 18:21:37.892923 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 255/518] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:21:38.234872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-70db1cf6-ba1d-485e-af0e-9867c71dccab tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:38.235484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-70db1cf6-ba1d-485e-af0e-9867c71dccab tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:38.242608 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-70db1cf6-ba1d-485e-af0e-9867c71dccab tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:38.243112 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-70db1cf6-ba1d-485e-af0e-9867c71dccab tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:38.243889 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-70db1cf6-ba1d-485e-af0e-9867c71dccab tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:38.244304 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-70db1cf6-ba1d-485e-af0e-9867c71dccab tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:38.355296 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a06184c9-f951-49cc-8e80-ad94490b83d1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:38.356287 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a06184c9-f951-49cc-8e80-ad94490b83d1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:38.363368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a06184c9-f951-49cc-8e80-ad94490b83d1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:38.363922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a06184c9-f951-49cc-8e80-ad94490b83d1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:38.364789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a06184c9-f951-49cc-8e80-ad94490b83d1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:38.365317 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a06184c9-f951-49cc-8e80-ad94490b83d1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:38.502446 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-70db1cf6-ba1d-485e-af0e-9867c71dccab tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:38.511062 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-70db1cf6-ba1d-485e-af0e-9867c71dccab tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.279951 May 26 18:21:38.518139 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 264/519] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:38 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:38.528415 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0efac81b-9dfa-4b04-b19e-b7a7a6cf049e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:38.529037 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0efac81b-9dfa-4b04-b19e-b7a7a6cf049e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:38.535298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0efac81b-9dfa-4b04-b19e-b7a7a6cf049e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:38.535761 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0efac81b-9dfa-4b04-b19e-b7a7a6cf049e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:38.536540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0efac81b-9dfa-4b04-b19e-b7a7a6cf049e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:38.536979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0efac81b-9dfa-4b04-b19e-b7a7a6cf049e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:38.653401 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a06184c9-f951-49cc-8e80-ad94490b83d1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:38.662066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a06184c9-f951-49cc-8e80-ad94490b83d1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.311968 May 26 18:21:38.662885 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 256/520] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:38 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:38.794873 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0efac81b-9dfa-4b04-b19e-b7a7a6cf049e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:38.804078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0efac81b-9dfa-4b04-b19e-b7a7a6cf049e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1759 microversion: 2.1 time: 0.279249 May 26 18:21:38.804867 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 265/521] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:38 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1759 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:39.528643 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7b76ca2f-2697-49aa-8294-25c3f8ec7615 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:39.529285 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7b76ca2f-2697-49aa-8294-25c3f8ec7615 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:39.535968 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7b76ca2f-2697-49aa-8294-25c3f8ec7615 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:39.536440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7b76ca2f-2697-49aa-8294-25c3f8ec7615 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:39.537284 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7b76ca2f-2697-49aa-8294-25c3f8ec7615 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:39.537743 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7b76ca2f-2697-49aa-8294-25c3f8ec7615 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:39.669950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7b76ca2f-2697-49aa-8294-25c3f8ec7615 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:39.678534 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7b76ca2f-2697-49aa-8294-25c3f8ec7615 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.153991 May 26 18:21:39.679134 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 257/522] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:39 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:39.681080 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4ffa2e7b-2c19-41e3-81bc-f6db521bcf02 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:39.681695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4ffa2e7b-2c19-41e3-81bc-f6db521bcf02 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:39.688153 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ffa2e7b-2c19-41e3-81bc-f6db521bcf02 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:39.688603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ffa2e7b-2c19-41e3-81bc-f6db521bcf02 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:39.689388 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ffa2e7b-2c19-41e3-81bc-f6db521bcf02 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:39.689895 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4ffa2e7b-2c19-41e3-81bc-f6db521bcf02 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:39.817336 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4ffa2e7b-2c19-41e3-81bc-f6db521bcf02 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:39.824804 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4ffa2e7b-2c19-41e3-81bc-f6db521bcf02 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.148330 May 26 18:21:39.825372 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 266/523] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:39 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:40.695410 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-72cc6212-f64c-4f64-a301-fdaa39879074 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:40.696060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-72cc6212-f64c-4f64-a301-fdaa39879074 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:40.702365 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-72cc6212-f64c-4f64-a301-fdaa39879074 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:40.702813 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-72cc6212-f64c-4f64-a301-fdaa39879074 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:40.703569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-72cc6212-f64c-4f64-a301-fdaa39879074 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:40.704005 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-72cc6212-f64c-4f64-a301-fdaa39879074 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:40.832448 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-72cc6212-f64c-4f64-a301-fdaa39879074 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:40.840551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-72cc6212-f64c-4f64-a301-fdaa39879074 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.149045 May 26 18:21:40.841125 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 258/524] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:40 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:40.841749 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0b1cbd04-ecb0-4729-9495-9206b45d7e37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:40.842399 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0b1cbd04-ecb0-4729-9495-9206b45d7e37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:40.849771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b1cbd04-ecb0-4729-9495-9206b45d7e37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:40.850241 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b1cbd04-ecb0-4729-9495-9206b45d7e37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:40.851014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b1cbd04-ecb0-4729-9495-9206b45d7e37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:40.851652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b1cbd04-ecb0-4729-9495-9206b45d7e37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:40.987223 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0b1cbd04-ecb0-4729-9495-9206b45d7e37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:40.995446 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0b1cbd04-ecb0-4729-9495-9206b45d7e37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1678 microversion: 2.1 time: 0.157471 May 26 18:21:40.996012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 267/525] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:40 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:41.858523 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-baa77b2c-e1e2-46ae-84a7-d2a7d9539143 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:41.859134 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-baa77b2c-e1e2-46ae-84a7-d2a7d9539143 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:41.865588 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-baa77b2c-e1e2-46ae-84a7-d2a7d9539143 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:41.866083 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-baa77b2c-e1e2-46ae-84a7-d2a7d9539143 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:41.866869 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-baa77b2c-e1e2-46ae-84a7-d2a7d9539143 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:41.867308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-baa77b2c-e1e2-46ae-84a7-d2a7d9539143 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:41.995443 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-baa77b2c-e1e2-46ae-84a7-d2a7d9539143 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:42.003495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-baa77b2c-e1e2-46ae-84a7-d2a7d9539143 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.148883 May 26 18:21:42.004102 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 259/526] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:41 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:42.012309 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d91b87fb-93b4-453c-ae38-89f5f66e9d4c tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:42.013033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d91b87fb-93b4-453c-ae38-89f5f66e9d4c tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:42.019610 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d91b87fb-93b4-453c-ae38-89f5f66e9d4c tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:42.020068 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d91b87fb-93b4-453c-ae38-89f5f66e9d4c tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:42.020832 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d91b87fb-93b4-453c-ae38-89f5f66e9d4c tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:42.021269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d91b87fb-93b4-453c-ae38-89f5f66e9d4c tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:42.159067 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d91b87fb-93b4-453c-ae38-89f5f66e9d4c tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:42.167217 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d91b87fb-93b4-453c-ae38-89f5f66e9d4c tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1655 microversion: 2.1 time: 0.158809 May 26 18:21:42.167789 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 268/527] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:42 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:42.184664 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-de1b8882-7786-4da2-92a7-3748274e725f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:42.190728 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de1b8882-7786-4da2-92a7-3748274e725f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:42.191170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de1b8882-7786-4da2-92a7-3748274e725f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:42.212596 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-de1b8882-7786-4da2-92a7-3748274e725f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Going to try to start instance {{(pid=117697) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 18:21:42.254665 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-de1b8882-7786-4da2-92a7-3748274e725f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/action" status: 202 len: 0 microversion: 2.1 time: 0.073758 May 26 18:21:42.255324 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 260/528] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:21:42 2022] POST /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:21:42.263895 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3c9f3a5f-b07e-4792-a9fb-27f690e088ca tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:42.264615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3c9f3a5f-b07e-4792-a9fb-27f690e088ca tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:42.271931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3c9f3a5f-b07e-4792-a9fb-27f690e088ca tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:42.272405 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3c9f3a5f-b07e-4792-a9fb-27f690e088ca tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:42.273888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3c9f3a5f-b07e-4792-a9fb-27f690e088ca tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:42.274339 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3c9f3a5f-b07e-4792-a9fb-27f690e088ca tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:42.590439 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3c9f3a5f-b07e-4792-a9fb-27f690e088ca tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:42.598606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3c9f3a5f-b07e-4792-a9fb-27f690e088ca tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1664 microversion: 2.1 time: 0.338495 May 26 18:21:42.599263 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 269/529] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:42 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1664 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:43.021146 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-098d72d9-7163-4582-8454-7c908ca198d7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:43.021884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-098d72d9-7163-4582-8454-7c908ca198d7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:43.029372 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-098d72d9-7163-4582-8454-7c908ca198d7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:43.029867 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-098d72d9-7163-4582-8454-7c908ca198d7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:43.030639 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-098d72d9-7163-4582-8454-7c908ca198d7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:43.031081 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-098d72d9-7163-4582-8454-7c908ca198d7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:43.161581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-098d72d9-7163-4582-8454-7c908ca198d7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:43.170009 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-098d72d9-7163-4582-8454-7c908ca198d7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.153083 May 26 18:21:43.170584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 261/530] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:43 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:43.616196 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f1f6a384-a6c6-4349-899f-c2985fd8869d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:43.616840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f1f6a384-a6c6-4349-899f-c2985fd8869d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:43.623916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f1f6a384-a6c6-4349-899f-c2985fd8869d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:43.624374 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f1f6a384-a6c6-4349-899f-c2985fd8869d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:43.625151 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f1f6a384-a6c6-4349-899f-c2985fd8869d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:43.625593 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f1f6a384-a6c6-4349-899f-c2985fd8869d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:43.783958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f1f6a384-a6c6-4349-899f-c2985fd8869d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:43.792324 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f1f6a384-a6c6-4349-899f-c2985fd8869d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1664 microversion: 2.1 time: 0.180327 May 26 18:21:43.792885 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 270/531] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:43 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:44.188107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-959c2990-95c5-45c6-850e-d68e29651e02 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:44.188669 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-959c2990-95c5-45c6-850e-d68e29651e02 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:44.196228 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-959c2990-95c5-45c6-850e-d68e29651e02 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:44.196689 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-959c2990-95c5-45c6-850e-d68e29651e02 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:44.197462 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-959c2990-95c5-45c6-850e-d68e29651e02 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:44.197933 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-959c2990-95c5-45c6-850e-d68e29651e02 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:44.346419 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-959c2990-95c5-45c6-850e-d68e29651e02 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:44.354775 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-959c2990-95c5-45c6-850e-d68e29651e02 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1735 microversion: 2.1 time: 0.170694 May 26 18:21:44.355361 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 262/532] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:44 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:44.810785 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-256be3c6-c738-44ba-ba55-f19875591c30 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:44.811307 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-256be3c6-c738-44ba-ba55-f19875591c30 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:44.817966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-256be3c6-c738-44ba-ba55-f19875591c30 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:44.818425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-256be3c6-c738-44ba-ba55-f19875591c30 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:44.819188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-256be3c6-c738-44ba-ba55-f19875591c30 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:44.819632 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-256be3c6-c738-44ba-ba55-f19875591c30 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:44.946987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-256be3c6-c738-44ba-ba55-f19875591c30 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:44.957118 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-256be3c6-c738-44ba-ba55-f19875591c30 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1668 microversion: 2.1 time: 0.150515 May 26 18:21:44.957685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 271/533] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:44 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:45.372331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-dc166265-b746-4755-8833-41e665dac1e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:45.372947 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-dc166265-b746-4755-8833-41e665dac1e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:45.379526 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dc166265-b746-4755-8833-41e665dac1e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:45.380015 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dc166265-b746-4755-8833-41e665dac1e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:45.380778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dc166265-b746-4755-8833-41e665dac1e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:45.381217 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dc166265-b746-4755-8833-41e665dac1e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:45.511140 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-dc166265-b746-4755-8833-41e665dac1e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:45.519071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-dc166265-b746-4755-8833-41e665dac1e9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1715 microversion: 2.1 time: 0.150604 May 26 18:21:45.519630 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 263/534] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:45 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:45.623333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:45.623817 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:45.629763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:45.630224 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:45.630984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:45.631417 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:45.714697 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] HTTP exception thrown: Cannot 'detach_volume' instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 while it is in vm_state rescued May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Request method failure captured: May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments/12317390-60a8-493f-9b29-0f6e526ce9fa HTTP/1.1 May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RWODLYi3wdaspll1zSy4mFYh46s3GN57iRM-L_-oq2PC7kcMeh3vdvzheNADnGzneVMfEKJQD3fIE7UbLMCCJH1QIAx7okekyzdCgqUMi23a9gOm7NEbdM2gUEcXOy9FAQIbx6XMUkM4IF8RynHZWEW4I9HmMmXTcFriT68BGeYPA May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:21:45.716421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5cb09766b9784d50aad144d466a5d050", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3b3f8de4a3b54d58806506b827cfa89a May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:21:45.718009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Cannot 'detach_volume' instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 while it is in vm_state rescued May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'server_id': '97dd8752-9cc1-438c-830c-4f34e8c05fd6', 'id': '12317390-60a8-493f-9b29-0f6e526ce9fa'} May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:21:45.718835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 while it is in vm_state rescued May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 while it is in vm_state rescued May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:21:45.720184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Returning 409 to user: Cannot 'detach_volume' instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 while it is in vm_state rescued {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:21:45.721274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b84c3889-4f10-428c-9fb5-fcf1a8a2dc60 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments/12317390-60a8-493f-9b29-0f6e526ce9fa" status: 409 len: 152 microversion: 2.1 time: 0.098631 May 26 18:21:45.721274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 272/535] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:21:45 2022] DELETE /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments/12317390-60a8-493f-9b29-0f6e526ce9fa => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 18:21:45.727502 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f989ae03-c3f3-4395-b777-ba8d5ccee29a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:45.728309 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f989ae03-c3f3-4395-b777-ba8d5ccee29a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:45.734686 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f989ae03-c3f3-4395-b777-ba8d5ccee29a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:45.735143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f989ae03-c3f3-4395-b777-ba8d5ccee29a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:45.735928 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f989ae03-c3f3-4395-b777-ba8d5ccee29a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:45.736375 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f989ae03-c3f3-4395-b777-ba8d5ccee29a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:45.806667 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f989ae03-c3f3-4395-b777-ba8d5ccee29a tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "POST /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/action" status: 202 len: 0 microversion: 2.1 time: 0.082856 May 26 18:21:45.807308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 264/536] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:21:45 2022] POST /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:21:45.816129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-85bd9488-5c2e-423e-867d-c15bfdf2249f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:45.816852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-85bd9488-5c2e-423e-867d-c15bfdf2249f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:45.826038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85bd9488-5c2e-423e-867d-c15bfdf2249f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:45.826591 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85bd9488-5c2e-423e-867d-c15bfdf2249f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:45.828032 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85bd9488-5c2e-423e-867d-c15bfdf2249f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:45.828553 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-85bd9488-5c2e-423e-867d-c15bfdf2249f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:46.399696 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-85bd9488-5c2e-423e-867d-c15bfdf2249f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:46.407843 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-85bd9488-5c2e-423e-867d-c15bfdf2249f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1723 microversion: 2.1 time: 0.596236 May 26 18:21:46.408410 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 273/537] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:45 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1723 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:47.426201 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-133a474e-e6e3-4b56-bd51-e38f914f8152 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:47.426888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-133a474e-e6e3-4b56-bd51-e38f914f8152 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:47.434443 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-133a474e-e6e3-4b56-bd51-e38f914f8152 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:47.434890 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-133a474e-e6e3-4b56-bd51-e38f914f8152 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:47.435636 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-133a474e-e6e3-4b56-bd51-e38f914f8152 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:47.436066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-133a474e-e6e3-4b56-bd51-e38f914f8152 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:47.568948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-133a474e-e6e3-4b56-bd51-e38f914f8152 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:47.576963 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-133a474e-e6e3-4b56-bd51-e38f914f8152 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1723 microversion: 2.1 time: 0.155193 May 26 18:21:47.577463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 265/538] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:47 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:48.595158 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ad60f96-222b-45ca-99f6-64da0b97d697 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:48.595696 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ad60f96-222b-45ca-99f6-64da0b97d697 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:48.602464 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ad60f96-222b-45ca-99f6-64da0b97d697 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:48.602922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ad60f96-222b-45ca-99f6-64da0b97d697 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:48.603692 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ad60f96-222b-45ca-99f6-64da0b97d697 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:48.604138 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ad60f96-222b-45ca-99f6-64da0b97d697 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:48.733268 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ad60f96-222b-45ca-99f6-64da0b97d697 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:48.741164 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ad60f96-222b-45ca-99f6-64da0b97d697 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1723 microversion: 2.1 time: 0.150106 May 26 18:21:48.742498 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 274/539] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:48 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:49.760861 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-93ace629-3b65-41c3-b46f-571aa828e140 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:49.761474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-93ace629-3b65-41c3-b46f-571aa828e140 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:49.768016 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-93ace629-3b65-41c3-b46f-571aa828e140 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:49.768463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-93ace629-3b65-41c3-b46f-571aa828e140 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:49.769222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-93ace629-3b65-41c3-b46f-571aa828e140 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:49.769656 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-93ace629-3b65-41c3-b46f-571aa828e140 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:49.784159 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:49.904713 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-93ace629-3b65-41c3-b46f-571aa828e140 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:49.912727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-93ace629-3b65-41c3-b46f-571aa828e140 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1729 microversion: 2.1 time: 0.156361 May 26 18:21:49.913297 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 266/540] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:21:49 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:49.929066 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-893b8606-f7b8-4903-80ea-741ed9a977aa tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:49.929565 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-893b8606-f7b8-4903-80ea-741ed9a977aa tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:49.936615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-893b8606-f7b8-4903-80ea-741ed9a977aa tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:49.937062 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-893b8606-f7b8-4903-80ea-741ed9a977aa tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:49.937850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-893b8606-f7b8-4903-80ea-741ed9a977aa tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:49.938289 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-893b8606-f7b8-4903-80ea-741ed9a977aa tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:50.016507 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-893b8606-f7b8-4903-80ea-741ed9a977aa tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091234 May 26 18:21:50.017147 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 275/541] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 18:21:49 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:21:50.889753 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-313c1796-2d97-40e5-be16-e2dc85ea60c5 req-4fcad8d1-456d-4a0d-b1a4-9037f274aa51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97dd8752-9cc1-438c-830c-4f34e8c05fd6", "tag": "baefe40e-bfcc-4cf6-bbb3-6273d240e5d0"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:50.899068 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-313c1796-2d97-40e5-be16-e2dc85ea60c5 req-4fcad8d1-456d-4a0d-b1a4-9037f274aa51 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:50.899524 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-313c1796-2d97-40e5-be16-e2dc85ea60c5 req-4fcad8d1-456d-4a0d-b1a4-9037f274aa51 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:50.913313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-313c1796-2d97-40e5-be16-e2dc85ea60c5 req-4fcad8d1-456d-4a0d-b1a4-9037f274aa51 service nova] Creating event network-changed:baefe40e-bfcc-4cf6-bbb3-6273d240e5d0 for instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 on hv-cinder-84349 May 26 18:21:50.918718 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-313c1796-2d97-40e5-be16-e2dc85ea60c5 req-4fcad8d1-456d-4a0d-b1a4-9037f274aa51 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032799 May 26 18:21:50.919323 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 267/542] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:21:52.933876 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-33ab4503-b2d0-42ee-8f30-41e7a6f6e522 req-ea3ba195-325c-4c4a-a532-eea9e2c88b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97dd8752-9cc1-438c-830c-4f34e8c05fd6", "tag": "baefe40e-bfcc-4cf6-bbb3-6273d240e5d0"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:52.941921 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-33ab4503-b2d0-42ee-8f30-41e7a6f6e522 req-ea3ba195-325c-4c4a-a532-eea9e2c88b9b service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:52.942372 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-33ab4503-b2d0-42ee-8f30-41e7a6f6e522 req-ea3ba195-325c-4c4a-a532-eea9e2c88b9b service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:52.954063 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-33ab4503-b2d0-42ee-8f30-41e7a6f6e522 req-ea3ba195-325c-4c4a-a532-eea9e2c88b9b service nova] Creating event network-changed:baefe40e-bfcc-4cf6-bbb3-6273d240e5d0 for instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 on hv-cinder-84349 May 26 18:21:52.958952 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-33ab4503-b2d0-42ee-8f30-41e7a6f6e522 req-ea3ba195-325c-4c4a-a532-eea9e2c88b9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029937 May 26 18:21:52.959529 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 276/543] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:15.669957 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1989e5c6-4cce-401b-888e-6ec095c5b94c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:15.670531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1989e5c6-4cce-401b-888e-6ec095c5b94c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:15.672938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=47 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:15.673811 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=5 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:15.680081 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1989e5c6-4cce-401b-888e-6ec095c5b94c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:15.680533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1989e5c6-4cce-401b-888e-6ec095c5b94c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:15.681534 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1989e5c6-4cce-401b-888e-6ec095c5b94c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:15.682020 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1989e5c6-4cce-401b-888e-6ec095c5b94c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:15.712693 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1989e5c6-4cce-401b-888e-6ec095c5b94c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments/96f6e19a-507f-40c5-8f66-e47b9f4fe868" status: 200 len: 194 microversion: 2.20 time: 0.047379 May 26 18:22:15.713958 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 268/544] 10.222.0.46 () {60 vars in 1453 bytes} [Thu May 26 18:22:15 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments/96f6e19a-507f-40c5-8f66-e47b9f4fe868 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:22:15.774182 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=51 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:15.775011 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=74 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:15.780605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-11a70594-d94c-4194-a178-de3c28fb4fdd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:15.781214 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-11a70594-d94c-4194-a178-de3c28fb4fdd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:15.788170 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-11a70594-d94c-4194-a178-de3c28fb4fdd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:15.788620 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-11a70594-d94c-4194-a178-de3c28fb4fdd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:15.789381 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-11a70594-d94c-4194-a178-de3c28fb4fdd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:15.789840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-11a70594-d94c-4194-a178-de3c28fb4fdd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:15.871421 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-11a70594-d94c-4194-a178-de3c28fb4fdd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lazy-loading 'services' on Instance uuid aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:15.940948 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-11a70594-d94c-4194-a178-de3c28fb4fdd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments/96f6e19a-507f-40c5-8f66-e47b9f4fe868" status: 202 len: 0 microversion: 2.20 time: 0.168214 May 26 18:22:15.941539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 277/545] 10.222.0.46 () {60 vars in 1456 bytes} [Thu May 26 18:22:15 2022] DELETE /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments/96f6e19a-507f-40c5-8f66-e47b9f4fe868 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:22:15.950639 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b088b9fc-830d-46a4-92c5-305d766f94fb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:15.951562 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b088b9fc-830d-46a4-92c5-305d766f94fb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:15.957519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b088b9fc-830d-46a4-92c5-305d766f94fb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:15.958016 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b088b9fc-830d-46a4-92c5-305d766f94fb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:15.958779 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b088b9fc-830d-46a4-92c5-305d766f94fb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:15.959215 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b088b9fc-830d-46a4-92c5-305d766f94fb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:15.990629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b088b9fc-830d-46a4-92c5-305d766f94fb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044631 May 26 18:22:15.991197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 269/546] 10.222.0.46 () {60 vars in 1342 bytes} [Thu May 26 18:22:15 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:22:17.005018 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-37f2db3f-0a3f-4491-a2b4-d79ca211f148 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:17.006105 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-37f2db3f-0a3f-4491-a2b4-d79ca211f148 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:17.013048 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-37f2db3f-0a3f-4491-a2b4-d79ca211f148 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:17.013505 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-37f2db3f-0a3f-4491-a2b4-d79ca211f148 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:17.014317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-37f2db3f-0a3f-4491-a2b4-d79ca211f148 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:17.014766 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-37f2db3f-0a3f-4491-a2b4-d79ca211f148 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:17.043737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-37f2db3f-0a3f-4491-a2b4-d79ca211f148 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043621 May 26 18:22:17.044287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 278/547] 10.222.0.46 () {60 vars in 1342 bytes} [Thu May 26 18:22:16 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:17.107382 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a812c36b-c2e1-48f2-8716-dac6fd25a179 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:17.107884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a812c36b-c2e1-48f2-8716-dac6fd25a179 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:17.114230 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a812c36b-c2e1-48f2-8716-dac6fd25a179 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:17.114675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a812c36b-c2e1-48f2-8716-dac6fd25a179 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:17.115453 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a812c36b-c2e1-48f2-8716-dac6fd25a179 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:17.115885 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a812c36b-c2e1-48f2-8716-dac6fd25a179 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:17.142028 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a812c36b-c2e1-48f2-8716-dac6fd25a179 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:22:17.220331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a812c36b-c2e1-48f2-8716-dac6fd25a179 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 204 len: 0 microversion: 2.20 time: 0.117559 May 26 18:22:17.220922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 270/548] 10.222.0.46 () {60 vars in 1279 bytes} [Thu May 26 18:22:17 2022] DELETE /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 18:22:17.229838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:17.230629 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:17.236985 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:17.237436 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:17.238258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:17.238743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:17.375821 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:17.384225 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:17.386688 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:17.387877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ee1db70-9011-4b7c-8239-ea09c80acac7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.162648 May 26 18:22:17.388451 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 279/549] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:17 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:22:18.406789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:18.407496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:18.413956 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:18.414408 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:18.415171 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:18.415631 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:18.563888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:18.571858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:18.574068 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:18.575260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d39fc7d1-fdbb-4c04-a2b0-1ee86b399d97 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.172874 May 26 18:22:18.575808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 271/550] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:18 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:19.592979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:19.593534 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:19.600364 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:19.600838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:19.601612 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:19.602078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:19.877771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:19.885925 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:19.887295 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:19.888443 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4fd03e64-6d9e-4aad-9e3f-a43ea7379bab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 200 len: 1724 microversion: 2.20 time: 0.299584 May 26 18:22:19.889122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 280/551] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:19 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:20.283164 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-0d3b379d-5b9f-4274-8934-65dc46a846d2 req-3a1adfe3-fc68-4e81-89de-0856e9dd7d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0eeeed-f9b7-4526-bd2f-ac98a769fd80", "name": "network-vif-deleted", "tag": "1d3fd217-af97-47a7-9225-e698208d450f"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:20.294225 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-0d3b379d-5b9f-4274-8934-65dc46a846d2 req-3a1adfe3-fc68-4e81-89de-0856e9dd7d2a service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:20.294674 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-0d3b379d-5b9f-4274-8934-65dc46a846d2 req-3a1adfe3-fc68-4e81-89de-0856e9dd7d2a service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:20.308074 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-0d3b379d-5b9f-4274-8934-65dc46a846d2 req-3a1adfe3-fc68-4e81-89de-0856e9dd7d2a service nova] Creating event network-vif-deleted:1d3fd217-af97-47a7-9225-e698208d450f for instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 on hv-cinder-84349 May 26 18:22:20.314029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-0d3b379d-5b9f-4274-8934-65dc46a846d2 req-3a1adfe3-fc68-4e81-89de-0856e9dd7d2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034474 May 26 18:22:20.315144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 272/552] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:20.906996 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:20.907608 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:20.914001 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:20.914450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:20.915212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:20.916192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:20.929847 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] HTTP exception thrown: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Request method failure captured: May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 HTTP/1.1 May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8SWCyTrsAcHvjcPWXmgMr7CNljvR87yfbkUQhV1P8g1P3-p3NK9_ksuwNcdh9UM0MVmcOIkkUT5zp1MpiDYXg3w43qfLc9jhirBjRxqL5YDprnn4udU5pt37Az1-0onrFyeesRFE-rumsE8FMgMpFsjkaIeasrgORMt7pgODvW8st0 May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:22:20.932212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_84dc70884aff4a799bb8f38899766e81", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 7f2ffbc59c60455cb9cadda081e30381 May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:22:20.933910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'aa0eeeed-f9b7-4526-bd2f-ac98a769fd80'} May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:20.934872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:22:20.936355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:20.937652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Returning 404 to user: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:20.937652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-af95dd44-5400-433a-8807-e298c24ee8ce tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 404 len: 111 microversion: 2.20 time: 0.030604 May 26 18:22:20.937652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 281/553] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:20 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:22:20.944996 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-31f42879-1599-448c-b10f-e236f8e8c26b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '.version_select at 0x7f5f18e7c4c0>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:20.964737 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-31f42879-1599-448c-b10f-e236f8e8c26b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596646696" status: 204 len: 0 microversion: 2.20 time: 0.025046 May 26 18:22:20.965330 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 273/554] 10.222.0.46 () {60 vars in 1261 bytes} [Thu May 26 18:22:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596646696 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 18:22:21.565955 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8b110c1e-2c6b-4b32-85db-ee404f94fa69 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:21.566453 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8b110c1e-2c6b-4b32-85db-ee404f94fa69 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:21.573232 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b110c1e-2c6b-4b32-85db-ee404f94fa69 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:21.573682 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b110c1e-2c6b-4b32-85db-ee404f94fa69 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:21.574482 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b110c1e-2c6b-4b32-85db-ee404f94fa69 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:21.574923 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8b110c1e-2c6b-4b32-85db-ee404f94fa69 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:21.598701 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8b110c1e-2c6b-4b32-85db-ee404f94fa69 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/ips" status: 200 len: 150 microversion: 2.1 time: 0.036668 May 26 18:22:21.599316 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 282/555] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:22:21 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:21.625202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-df38dc47-5c48-4c03-8d98-f782a9d54f89 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'create', calling method: .version_select at 0x7f5f18d0e940>, body: {"keypair": {"name": "tempest-keypair-327814387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC56TTfvQ72U0SXJYQsP8KvxmsJY62evii3iNq4eNuZFwSnNkE+nkEhLaqYItTs/JCfmf3Hhs2ALkPdWqEPp5Wu8nvzrblc9pEm7uS/4fshq9jfxaHj2gBp2X5kMdaoRsg=="}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:21.640164 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-df38dc47-5c48-4c03-8d98-f782a9d54f89 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Getting quotas for project 84dc70884aff4a799bb8f38899766e81. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:22:21.644249 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-df38dc47-5c48-4c03-8d98-f782a9d54f89 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Getting quotas for user 7f2ffbc59c60455cb9cadda081e30381 and project 84dc70884aff4a799bb8f38899766e81. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:22:21.668595 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-df38dc47-5c48-4c03-8d98-f782a9d54f89 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047994 May 26 18:22:21.669536 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 274/556] 10.222.0.46 () {62 vars in 1199 bytes} [Thu May 26 18:22:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 18:22:22.939432 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-af8b6352-eb44-4ddd-9bf1-127e7f781c0b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45e0acc9-95bc-42fc-a235-c200f4520b34"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:22.940479 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-af8b6352-eb44-4ddd-9bf1-127e7f781c0b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:22.947958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af8b6352-eb44-4ddd-9bf1-127e7f781c0b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:22.948540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af8b6352-eb44-4ddd-9bf1-127e7f781c0b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:22.949310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af8b6352-eb44-4ddd-9bf1-127e7f781c0b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:22.949763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af8b6352-eb44-4ddd-9bf1-127e7f781c0b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:22.991377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-20418206", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b60b547b-b8f7-49ae-8ba6-53f64d41d871"}], "security_groups": [{"name": "tempest-securitygroup--344416526"}], "key_name": "tempest-keypair-327814387", "user_data": "}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:23.093596 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] validate_networks() for [('b60b547b-b8f7-49ae-8ba6-53f64d41d871', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:22:23.209137 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-af8b6352-eb44-4ddd-9bf1-127e7f781c0b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273486 May 26 18:22:23.209911 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 283/557] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:22:22 2022] POST /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:23.485822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:22:23.486250 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:22:23.486726 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:22:23.487139 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:22:23.487550 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:22:23.496830 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:23.497284 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:23.498123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:23.498567 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:23.514970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Getting quotas for project 84dc70884aff4a799bb8f38899766e81. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:22:23.518952 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Getting quotas for user 7f2ffbc59c60455cb9cadda081e30381 and project 84dc70884aff4a799bb8f38899766e81. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:22:23.530784 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:22:23.533140 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:22:23.577918 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-06917203-0988-4e43-b3aa-4e94d79086bb tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.591301 May 26 18:22:23.578566 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 275/558] 10.222.0.46 () {62 vars in 1187 bytes} [Thu May 26 18:22:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 26 18:22:23.595889 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b00f7cbf-3727-4cb0-8b70-e73aadb284b7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:23.597283 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b00f7cbf-3727-4cb0-8b70-e73aadb284b7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:23.679488 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b00f7cbf-3727-4cb0-8b70-e73aadb284b7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:23.688660 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b00f7cbf-3727-4cb0-8b70-e73aadb284b7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:23.690288 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b00f7cbf-3727-4cb0-8b70-e73aadb284b7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:23.691453 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b00f7cbf-3727-4cb0-8b70-e73aadb284b7 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1279 microversion: 2.20 time: 0.105993 May 26 18:22:23.692515 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 284/559] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:23 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:24.710857 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:24.711466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:24.719217 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:24.719683 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:24.720428 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:24.720932 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:24.788596 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:24.796558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:24.798098 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:24.799196 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d732b54a-ca2e-4cfc-8f76-9b3ccbc59d42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1337 microversion: 2.20 time: 0.092751 May 26 18:22:24.800032 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 276/560] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:24 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1337 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:25.817867 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:25.818483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:25.826535 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:25.827260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:25.828042 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:25.828492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:26.050271 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:26.060727 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:26.065235 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:26.067672 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8a5afb05-6233-49f9-87d1-f00fc469a49b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1404 microversion: 2.20 time: 0.253489 May 26 18:22:26.079056 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 285/561] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:25 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1404 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:26.079368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-6f2e62f5-3670-4461-8e41-31684baac120 req-7fb0abfe-38ba-4c3e-9444-e1bfb0f91529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f119e1-cd1f-4c56-bfed-f0d172ba0c8b", "tag": "889d39d4-d8a9-413d-850d-667746898381"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:26.097067 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-6f2e62f5-3670-4461-8e41-31684baac120 req-7fb0abfe-38ba-4c3e-9444-e1bfb0f91529 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:26.097684 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-6f2e62f5-3670-4461-8e41-31684baac120 req-7fb0abfe-38ba-4c3e-9444-e1bfb0f91529 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:26.111804 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-6f2e62f5-3670-4461-8e41-31684baac120 req-7fb0abfe-38ba-4c3e-9444-e1bfb0f91529 service nova] Creating event network-changed:889d39d4-d8a9-413d-850d-667746898381 for instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b on hv-cinder-84349 May 26 18:22:26.116789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-6f2e62f5-3670-4461-8e41-31684baac120 req-7fb0abfe-38ba-4c3e-9444-e1bfb0f91529 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048028 May 26 18:22:26.117398 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 277/562] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:26.595331 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9b0f1b21-4414-460e-a43e-3cf3cff8670e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:26.596380 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9b0f1b21-4414-460e-a43e-3cf3cff8670e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:26.602844 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b21-4414-460e-a43e-3cf3cff8670e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:26.603296 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b21-4414-460e-a43e-3cf3cff8670e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:26.604248 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b21-4414-460e-a43e-3cf3cff8670e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:26.604688 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b21-4414-460e-a43e-3cf3cff8670e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:26.633970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9b0f1b21-4414-460e-a43e-3cf3cff8670e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042590 May 26 18:22:26.635231 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 286/563] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:26 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:22:26.696277 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-715a4a1c-70e2-4086-802a-6f03d6005343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:26.697515 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-715a4a1c-70e2-4086-802a-6f03d6005343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:26.703729 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-715a4a1c-70e2-4086-802a-6f03d6005343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:26.704172 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-715a4a1c-70e2-4086-802a-6f03d6005343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:26.704926 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-715a4a1c-70e2-4086-802a-6f03d6005343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:26.705360 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-715a4a1c-70e2-4086-802a-6f03d6005343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:26.729463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-715a4a1c-70e2-4086-802a-6f03d6005343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:22:26.800095 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-715a4a1c-70e2-4086-802a-6f03d6005343 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 204 len: 0 microversion: 2.1 time: 0.107460 May 26 18:22:26.800662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 278/564] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:22:26 2022] DELETE /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:22:26.809481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-89a275f6-5b8d-41f9-896a-42f1730e1129 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:26.810116 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-89a275f6-5b8d-41f9-896a-42f1730e1129 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:26.815927 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-89a275f6-5b8d-41f9-896a-42f1730e1129 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:26.816373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-89a275f6-5b8d-41f9-896a-42f1730e1129 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:26.817125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-89a275f6-5b8d-41f9-896a-42f1730e1129 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:26.817559 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-89a275f6-5b8d-41f9-896a-42f1730e1129 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:26.965379 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-89a275f6-5b8d-41f9-896a-42f1730e1129 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:26.972940 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-89a275f6-5b8d-41f9-896a-42f1730e1129 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1674 microversion: 2.1 time: 0.168058 May 26 18:22:26.973503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 287/565] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:26 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:27.085941 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:27.086543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:27.092850 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:27.093293 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:27.094076 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:27.094504 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:27.229652 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:27.241174 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:27.242705 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:27.243857 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-87218949-5115-466f-9cae-296df65a0f0b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1404 microversion: 2.20 time: 0.162253 May 26 18:22:27.244548 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 279/566] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:27 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:27.990592 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dad20fe1-639b-4565-816f-5556546588ce tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:27.991191 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dad20fe1-639b-4565-816f-5556546588ce tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:27.997852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dad20fe1-639b-4565-816f-5556546588ce tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:27.998309 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dad20fe1-639b-4565-816f-5556546588ce tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:27.999081 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dad20fe1-639b-4565-816f-5556546588ce tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:27.999522 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dad20fe1-639b-4565-816f-5556546588ce tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:28.126092 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-dad20fe1-639b-4565-816f-5556546588ce tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:28.133519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-dad20fe1-639b-4565-816f-5556546588ce tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1674 microversion: 2.1 time: 0.146830 May 26 18:22:28.134110 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 288/567] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:27 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:28.261926 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:28.262464 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:28.268900 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:28.269355 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:28.270146 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:28.270580 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:28.399351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:28.408556 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:28.410107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:28.411237 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8196dc7e-94b1-4f1b-8057-224e5e6ca12c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1404 microversion: 2.20 time: 0.153374 May 26 18:22:28.411803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 280/568] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:28 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:29.151720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-abd44c9b-92b3-40f6-8b3c-6768f46e80d3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:29.152328 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-abd44c9b-92b3-40f6-8b3c-6768f46e80d3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:29.158740 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-abd44c9b-92b3-40f6-8b3c-6768f46e80d3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:29.159188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-abd44c9b-92b3-40f6-8b3c-6768f46e80d3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:29.159941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-abd44c9b-92b3-40f6-8b3c-6768f46e80d3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:29.160376 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-abd44c9b-92b3-40f6-8b3c-6768f46e80d3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:29.340600 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-abd44c9b-92b3-40f6-8b3c-6768f46e80d3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:29.349099 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-abd44c9b-92b3-40f6-8b3c-6768f46e80d3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1674 microversion: 2.1 time: 0.202307 May 26 18:22:29.349864 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 289/569] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:29 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1674 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:29.430157 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:29.430697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:29.437158 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:29.437611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:29.438417 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:29.438851 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:29.878675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:29.886980 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:29.888547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:29.889671 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ebd1d137-1800-4b05-8c55-03b7bf85564b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1404 microversion: 2.20 time: 0.463636 May 26 18:22:29.890269 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 281/570] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:29 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:30.366840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7b936280-1c62-40b2-b438-5c49ebb93db3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:30.367434 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7b936280-1c62-40b2-b438-5c49ebb93db3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:30.374498 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b936280-1c62-40b2-b438-5c49ebb93db3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:30.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b936280-1c62-40b2-b438-5c49ebb93db3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:30.375727 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b936280-1c62-40b2-b438-5c49ebb93db3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:30.376166 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b936280-1c62-40b2-b438-5c49ebb93db3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:30.692425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b936280-1c62-40b2-b438-5c49ebb93db3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:30.705319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7b936280-1c62-40b2-b438-5c49ebb93db3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1674 microversion: 2.1 time: 0.342203 May 26 18:22:30.706038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 290/571] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:30 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1674 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:30.762602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45e0acc9-95bc-42fc-a235-c200f4520b34"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:30.763705 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:30.770422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:30.770895 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:30.771649 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:30.772087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:30.855987 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Invalid volume: volume 45e0acc9-95bc-42fc-a235-c200f4520b34 is already attached to instances: f5e1d369-3bad-49f8-8830-1f1206e60780 May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: POST /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments HTTP/1.1 May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 74 May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:22:30.857776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {"volumeAttachment": {"volumeId": "45e0acc9-95bc-42fc-a235-c200f4520b34"}} May 26 18:22:30.859389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Invalid volume: volume 45e0acc9-95bc-42fc-a235-c200f4520b34 is already attached to instances: f5e1d369-3bad-49f8-8830-1f1206e60780 May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'server_id': 'f5e1d369-3bad-49f8-8830-1f1206e60780', 'body': {'volumeAttachment': {'volumeId': '45e0acc9-95bc-42fc-a235-c200f4520b34'}}} May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 45e0acc9-95bc-42fc-a235-c200f4520b34 is already attached to instances: f5e1d369-3bad-49f8-8830-1f1206e60780 May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:30.863554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 45e0acc9-95bc-42fc-a235-c200f4520b34 is already attached to instances: f5e1d369-3bad-49f8-8830-1f1206e60780 May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:30.864897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:30.866435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:30.866435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:30.866435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:30.866435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 45e0acc9-95bc-42fc-a235-c200f4520b34 is already attached to instances: f5e1d369-3bad-49f8-8830-1f1206e60780 May 26 18:22:30.866435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:30.866435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 400 to user: Invalid volume: volume 45e0acc9-95bc-42fc-a235-c200f4520b34 is already attached to instances: f5e1d369-3bad-49f8-8830-1f1206e60780 {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:30.866435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-636fd61d-accc-431b-a67b-aeb7ddc26866 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100991 May 26 18:22:30.866435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 282/572] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:22:30 2022] POST /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:22:30.908258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:30.909308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:30.919706 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:30.920394 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:30.922239 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:30.923436 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:30.925584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-75a95e1d-7eae-4a69-b8c6-cf626ad16043 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:30.926103 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-75a95e1d-7eae-4a69-b8c6-cf626ad16043 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:30.933208 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-75a95e1d-7eae-4a69-b8c6-cf626ad16043 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:30.933659 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-75a95e1d-7eae-4a69-b8c6-cf626ad16043 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:30.934467 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-75a95e1d-7eae-4a69-b8c6-cf626ad16043 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:30.934904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-75a95e1d-7eae-4a69-b8c6-cf626ad16043 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.059560 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-75a95e1d-7eae-4a69-b8c6-cf626ad16043 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'services' on Instance uuid f5e1d369-3bad-49f8-8830-1f1206e60780 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:31.126237 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:31.137609 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:31.139276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:31.140643 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a417e22d-8468-4a43-a619-16a1a397c99d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1404 microversion: 2.20 time: 0.236906 May 26 18:22:31.141320 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 291/573] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:30 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:22:31.180789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-75a95e1d-7eae-4a69-b8c6-cf626ad16043 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments/45e0acc9-95bc-42fc-a235-c200f4520b34" status: 202 len: 0 microversion: 2.1 time: 0.256522 May 26 18:22:31.180789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 283/574] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:22:30 2022] DELETE /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments/45e0acc9-95bc-42fc-a235-c200f4520b34 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:22:31.188657 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-82ac8ff4-7319-45cd-896a-2497f9e16f06 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:31.189646 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-82ac8ff4-7319-45cd-896a-2497f9e16f06 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:31.196650 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82ac8ff4-7319-45cd-896a-2497f9e16f06 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.197977 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82ac8ff4-7319-45cd-896a-2497f9e16f06 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.199189 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82ac8ff4-7319-45cd-896a-2497f9e16f06 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.199879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82ac8ff4-7319-45cd-896a-2497f9e16f06 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.242616 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-82ac8ff4-7319-45cd-896a-2497f9e16f06 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058783 May 26 18:22:31.255163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 292/575] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:31 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:31.267826 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-d675878a-1a2c-440e-a10e-84b69880ac17 req-ac43bcc2-4d68-457c-8e22-b869293ae3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1715d8f6-ce4b-48d3-96b0-0717bc0ac54a", "name": "network-vif-deleted", "tag": "5791c3dc-854e-4168-8bdd-187fa96c5f33"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:31.278452 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-d675878a-1a2c-440e-a10e-84b69880ac17 req-ac43bcc2-4d68-457c-8e22-b869293ae3cc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.279063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-d675878a-1a2c-440e-a10e-84b69880ac17 req-ac43bcc2-4d68-457c-8e22-b869293ae3cc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.298542 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-d675878a-1a2c-440e-a10e-84b69880ac17 req-ac43bcc2-4d68-457c-8e22-b869293ae3cc service nova] Creating event network-vif-deleted:5791c3dc-854e-4168-8bdd-187fa96c5f33 for instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a on hv-cinder-84349 May 26 18:22:31.314814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-d675878a-1a2c-440e-a10e-84b69880ac17 req-ac43bcc2-4d68-457c-8e22-b869293ae3cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050784 May 26 18:22:31.315968 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 284/576] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:31.723156 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:31.723776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:31.731897 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.732357 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.733151 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.733657 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.753932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:31.769442 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.769935 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.770398 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lazy-loading 'fault' on Instance uuid 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:31.772646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0d9af1fe-82d2-4835-be12-80991e2aa1e7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:31.773230 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0d9af1fe-82d2-4835-be12-80991e2aa1e7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:31.781880 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0d9af1fe-82d2-4835-be12-80991e2aa1e7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.782620 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0d9af1fe-82d2-4835-be12-80991e2aa1e7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.783580 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0d9af1fe-82d2-4835-be12-80991e2aa1e7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.784162 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0d9af1fe-82d2-4835-be12-80991e2aa1e7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.810420 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:31.818377 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:31.830394 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0b53b30a-6326-4df8-83dd-4582e9387e13 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 200 len: 1328 microversion: 2.1 time: 0.111089 May 26 18:22:31.833961 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 293/577] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:31 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:31.879265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-0d9af1fe-82d2-4835-be12-80991e2aa1e7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lazy-loading 'services' on Instance uuid 97dd8752-9cc1-438c-830c-4f34e8c05fd6 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:31.967467 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0d9af1fe-82d2-4835-be12-80991e2aa1e7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments/12317390-60a8-493f-9b29-0f6e526ce9fa" status: 202 len: 0 microversion: 2.1 time: 0.199138 May 26 18:22:31.968381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 285/578] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:22:31 2022] DELETE /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments/12317390-60a8-493f-9b29-0f6e526ce9fa => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:22:31.977218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b52e360a-feac-4f7d-b0a9-1818b880b455 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:31.978448 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b52e360a-feac-4f7d-b0a9-1818b880b455 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:31.984941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b52e360a-feac-4f7d-b0a9-1818b880b455 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.985537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b52e360a-feac-4f7d-b0a9-1818b880b455 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:31.986471 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b52e360a-feac-4f7d-b0a9-1818b880b455 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:31.987034 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b52e360a-feac-4f7d-b0a9-1818b880b455 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:32.019545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-4aac1eb3-70d1-4ff2-8e6f-07b0c8a3bc06 req-3067a422-c4a9-4c88-85b6-02b47963d50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f119e1-cd1f-4c56-bfed-f0d172ba0c8b", "name": "network-vif-plugged", "status": "completed", "tag": "889d39d4-d8a9-413d-850d-667746898381"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:32.030091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-4aac1eb3-70d1-4ff2-8e6f-07b0c8a3bc06 req-3067a422-c4a9-4c88-85b6-02b47963d50d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:32.030479 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b52e360a-feac-4f7d-b0a9-1818b880b455 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057586 May 26 18:22:32.031000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-4aac1eb3-70d1-4ff2-8e6f-07b0c8a3bc06 req-3067a422-c4a9-4c88-85b6-02b47963d50d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:32.034861 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 294/579] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:31 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:32.057138 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-4aac1eb3-70d1-4ff2-8e6f-07b0c8a3bc06 req-3067a422-c4a9-4c88-85b6-02b47963d50d service nova] Creating event network-vif-plugged:889d39d4-d8a9-413d-850d-667746898381 for instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b on hv-cinder-84349 May 26 18:22:32.063590 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-4aac1eb3-70d1-4ff2-8e6f-07b0c8a3bc06 req-3067a422-c4a9-4c88-85b6-02b47963d50d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060560 May 26 18:22:32.064400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 286/580] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:32.159532 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:32.161149 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:32.169966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:32.170731 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:32.172218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:32.172815 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:32.268754 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-39e4266b-b501-4918-9c54-01641ee20ebd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:32.270259 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-39e4266b-b501-4918-9c54-01641ee20ebd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:32.278741 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-39e4266b-b501-4918-9c54-01641ee20ebd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:32.279486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-39e4266b-b501-4918-9c54-01641ee20ebd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:32.280305 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-39e4266b-b501-4918-9c54-01641ee20ebd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:32.281092 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-39e4266b-b501-4918-9c54-01641ee20ebd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:32.331029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-39e4266b-b501-4918-9c54-01641ee20ebd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066915 May 26 18:22:32.332029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 287/581] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:32 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:32.394924 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:32.406836 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:32.408715 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:32.409874 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c63c6e16-a1f7-4eb0-b735-be68e7771bd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1404 microversion: 2.20 time: 0.254915 May 26 18:22:32.410664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 295/582] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:32 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:32.848910 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:32.849618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:32.856903 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:32.857340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:32.858145 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:32.858574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:32.873478 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] HTTP exception thrown: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Request method failure captured: May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a HTTP/1.1 May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RUeidLLWZvKkIiv5LYe-jCQYVpuqbEhBZll1iy3CuqeHZX_KjrDJT_-gy2d5oJvdHMmOd45SWnZ9NK0R6XgAjoGG3FNo5PWb6PdbQP6ztummbfZhGq6GqBxxTZQ2j8figZwl5TYVnMjlKTdx4tI2YfnHwqPsfb38LJA5CV_8mhOto May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:22:32.875854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c2a09a6e81240889c49b5abb24ab225", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeTestJSON-740129577 May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeTestJSON-740129577-project May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: a20f6932d763461ea26c2d60ed58a59f May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeTestJSON-740129577-project May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:22:32.877862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '1715d8f6-ce4b-48d3-96b0-0717bc0ac54a'} May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:32.879117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:22:32.880602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:32.882011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Returning 404 to user: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:32.882011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6751c1b5-4e82-4b98-8544-1956e311265d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 404 len: 111 microversion: 2.1 time: 0.032735 May 26 18:22:32.882011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 288/583] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:32 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:22:32.889880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-01c6a316-c735-437f-870c-8e585a2d7798 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '.version_select at 0x7f5f183f2ca0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:32.912106 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-01c6a316-c735-437f-870c-8e585a2d7798 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732374166" status: 202 len: 0 microversion: 2.1 time: 0.027746 May 26 18:22:32.913111 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 296/584] 10.222.0.46 () {58 vars in 1220 bytes} [Thu May 26 18:22:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732374166 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:22:33.042133 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-988880b3-ec1f-4c04-8cea-896d5a2b13f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:33.043425 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-988880b3-ec1f-4c04-8cea-896d5a2b13f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:33.051263 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-988880b3-ec1f-4c04-8cea-896d5a2b13f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.051841 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-988880b3-ec1f-4c04-8cea-896d5a2b13f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.052734 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-988880b3-ec1f-4c04-8cea-896d5a2b13f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.053388 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-988880b3-ec1f-4c04-8cea-896d5a2b13f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.094789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-988880b3-ec1f-4c04-8cea-896d5a2b13f7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056617 May 26 18:22:33.096438 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 289/585] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:33 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:33.344345 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-22bfa06e-867e-4996-8062-3135b327b6c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:33.345975 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-22bfa06e-867e-4996-8062-3135b327b6c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:33.355703 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22bfa06e-867e-4996-8062-3135b327b6c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.356154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22bfa06e-867e-4996-8062-3135b327b6c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.358143 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22bfa06e-867e-4996-8062-3135b327b6c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.358592 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22bfa06e-867e-4996-8062-3135b327b6c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.403083 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-22bfa06e-867e-4996-8062-3135b327b6c3 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063472 May 26 18:22:33.403676 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 297/586] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:33 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:22:33.433476 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:33.434667 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:33.441069 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.441498 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.442380 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.442862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.472472 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-71b455cd-d484-4e72-95af-a90d32d45f70 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:33.473065 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-71b455cd-d484-4e72-95af-a90d32d45f70 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:33.480619 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71b455cd-d484-4e72-95af-a90d32d45f70 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.483279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71b455cd-d484-4e72-95af-a90d32d45f70 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.483279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71b455cd-d484-4e72-95af-a90d32d45f70 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.483279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71b455cd-d484-4e72-95af-a90d32d45f70 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.506249 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:33.508462 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-71b455cd-d484-4e72-95af-a90d32d45f70 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:22:33.526027 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=10 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:33.598272 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-71b455cd-d484-4e72-95af-a90d32d45f70 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 204 len: 0 microversion: 2.1 time: 0.129813 May 26 18:22:33.598993 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 298/587] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:22:33 2022] DELETE /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:22:33.608283 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-53caacad-d205-414d-bc50-6d4e671c9646 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:33.609263 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-53caacad-d205-414d-bc50-6d4e671c9646 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:33.614967 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53caacad-d205-414d-bc50-6d4e671c9646 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.615424 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53caacad-d205-414d-bc50-6d4e671c9646 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.617484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53caacad-d205-414d-bc50-6d4e671c9646 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:33.617484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-53caacad-d205-414d-bc50-6d4e671c9646 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:33.654905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:33.663986 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:33.665720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:33.667061 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b3e37db5-e52d-4565-8412-d31bf30b15ad tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1404 microversion: 2.20 time: 0.242077 May 26 18:22:33.677708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 290/588] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:33 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1404 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:22:33.677708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5ccaa052-aad8-43a6-9547-69087222a733 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'create', calling method: .version_select at 0x7f5f18d81550>, body: {"keypair": {"name": "tempest-keypair-151836009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAZWHRetyA0AiCIVzKq1l7KKAPYy8sja9hl/E34AXlNDOigFCXxMWlP+InWgf96MRgUBA6+CAiRQoc/2kZtLDydwsDVqNcEUYT9QP9UR58LSz5GaJRDR8o6QVRtpE2vuA=="}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:33.684785 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:33.699513 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-5ccaa052-aad8-43a6-9547-69087222a733 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Getting quotas for project 0c2a09a6e81240889c49b5abb24ab225. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:22:33.705892 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-5ccaa052-aad8-43a6-9547-69087222a733 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Getting quotas for user a20f6932d763461ea26c2d60ed58a59f and project 0c2a09a6e81240889c49b5abb24ab225. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:22:33.734929 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5ccaa052-aad8-43a6-9547-69087222a733 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065136 May 26 18:22:33.735946 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 291/589] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:22:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:33.768631 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-53caacad-d205-414d-bc50-6d4e671c9646 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:33.777639 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-53caacad-d205-414d-bc50-6d4e671c9646 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1683 microversion: 2.1 time: 0.173434 May 26 18:22:33.778249 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 299/590] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:33 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:34.109507 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-99433fff-2b22-43a0-a89c-49e7b8f7577f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:34.111117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-99433fff-2b22-43a0-a89c-49e7b8f7577f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:34.114106 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:34.120930 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-99433fff-2b22-43a0-a89c-49e7b8f7577f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.121384 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-99433fff-2b22-43a0-a89c-49e7b8f7577f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.122190 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-99433fff-2b22-43a0-a89c-49e7b8f7577f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.122631 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-99433fff-2b22-43a0-a89c-49e7b8f7577f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.156362 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-99433fff-2b22-43a0-a89c-49e7b8f7577f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052854 May 26 18:22:34.157261 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 292/591] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:34 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:22:34.226494 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c081e98f-7ced-4f1a-b8a9-446cd4072212 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:34.227003 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c081e98f-7ced-4f1a-b8a9-446cd4072212 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:34.234208 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c081e98f-7ced-4f1a-b8a9-446cd4072212 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.234670 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c081e98f-7ced-4f1a-b8a9-446cd4072212 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.235449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c081e98f-7ced-4f1a-b8a9-446cd4072212 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.235895 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c081e98f-7ced-4f1a-b8a9-446cd4072212 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.261160 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c081e98f-7ced-4f1a-b8a9-446cd4072212 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:22:34.347261 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c081e98f-7ced-4f1a-b8a9-446cd4072212 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 204 len: 0 microversion: 2.1 time: 0.124329 May 26 18:22:34.348108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 300/592] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:22:34 2022] DELETE /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:22:34.356538 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6ba2e7fb-ee30-4a11-b5bd-6d0cc63543e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:34.357094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6ba2e7fb-ee30-4a11-b5bd-6d0cc63543e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:34.363058 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6ba2e7fb-ee30-4a11-b5bd-6d0cc63543e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.363515 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6ba2e7fb-ee30-4a11-b5bd-6d0cc63543e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.364290 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6ba2e7fb-ee30-4a11-b5bd-6d0cc63543e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.364731 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6ba2e7fb-ee30-4a11-b5bd-6d0cc63543e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.567314 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6ba2e7fb-ee30-4a11-b5bd-6d0cc63543e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:34.574984 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6ba2e7fb-ee30-4a11-b5bd-6d0cc63543e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1689 microversion: 2.1 time: 0.222412 May 26 18:22:34.575663 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 293/593] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:34 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:34.686709 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:34.687660 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:34.693560 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.694035 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.694793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.695223 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.796892 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a8394ee3-9bce-47ba-ad95-ee64b52cfd64 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:34.797495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a8394ee3-9bce-47ba-ad95-ee64b52cfd64 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:34.803824 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8394ee3-9bce-47ba-ad95-ee64b52cfd64 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.804265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8394ee3-9bce-47ba-ad95-ee64b52cfd64 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.805025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8394ee3-9bce-47ba-ad95-ee64b52cfd64 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.805450 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8394ee3-9bce-47ba-ad95-ee64b52cfd64 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.956250 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:34.964743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:34.966253 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:34.967399 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4f3ba0a9-1e89-4031-9003-b191f109dcae tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1595 microversion: 2.20 time: 0.285196 May 26 18:22:34.967958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 301/594] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:22:34 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1595 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:22:34.985468 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bc1aa11b-bf09-4740-9c17-37ab10129524 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:34.986210 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bc1aa11b-bf09-4740-9c17-37ab10129524 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:34.992519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bc1aa11b-bf09-4740-9c17-37ab10129524 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.992975 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bc1aa11b-bf09-4740-9c17-37ab10129524 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:34.993892 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bc1aa11b-bf09-4740-9c17-37ab10129524 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:34.994369 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bc1aa11b-bf09-4740-9c17-37ab10129524 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:35.309036 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a8394ee3-9bce-47ba-ad95-ee64b52cfd64 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:35.321814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a8394ee3-9bce-47ba-ad95-ee64b52cfd64 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1683 microversion: 2.1 time: 0.528955 May 26 18:22:35.322562 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 294/595] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:34 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1683 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:35.339345 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bc1aa11b-bf09-4740-9c17-37ab10129524 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.358021 May 26 18:22:35.339941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 302/596] 10.222.0.46 () {60 vars in 1315 bytes} [Thu May 26 18:22:34 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/os-interface => generated 284 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:22:35.590676 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1052423609", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c7075e7-d3fe-46a2-a6e3-f88506cd300f"}], "security_groups": [{"name": "tempest-securitygroup--752636613"}], "key_name": "tempest-keypair-151836009", "user_data": "}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:35.592009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-29f0d5d6-f938-4d91-b9c9-12af3a0da331 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:35.592625 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-29f0d5d6-f938-4d91-b9c9-12af3a0da331 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:35.599120 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-29f0d5d6-f938-4d91-b9c9-12af3a0da331 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:35.599308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-29f0d5d6-f938-4d91-b9c9-12af3a0da331 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:35.600093 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-29f0d5d6-f938-4d91-b9c9-12af3a0da331 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:35.600686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-29f0d5d6-f938-4d91-b9c9-12af3a0da331 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:35.747059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] validate_networks() for [('8c7075e7-d3fe-46a2-a6e3-f88506cd300f', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:22:35.789922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-29f0d5d6-f938-4d91-b9c9-12af3a0da331 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:35.798554 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-29f0d5d6-f938-4d91-b9c9-12af3a0da331 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1689 microversion: 2.1 time: 0.211016 May 26 18:22:35.808933 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 303/597] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:35 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:36.143112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:22:36.143608 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:22:36.144152 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:22:36.144631 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:22:36.145138 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:22:36.154341 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:36.154894 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:36.155763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:36.156312 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:36.173144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Getting quotas for project 0c2a09a6e81240889c49b5abb24ab225. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:22:36.177336 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Getting quotas for user a20f6932d763461ea26c2d60ed58a59f and project 0c2a09a6e81240889c49b5abb24ab225. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:22:36.188975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:22:36.191282 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:22:36.238782 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-43410c5d-c589-4a4e-8b69-a29bdcb1a6b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653014 May 26 18:22:36.239743 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 295/598] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:22:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:22:36.249443 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0bf35390-9cb8-40f0-bd2a-7ea4c33f326d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:36.250127 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0bf35390-9cb8-40f0-bd2a-7ea4c33f326d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:36.287494 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-0dc4e2e6-3c47-49d2-aff1-fc437d455001 req-e031e0b4-b0c7-499f-87d8-8a69266a25bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f119e1-cd1f-4c56-bfed-f0d172ba0c8b", "tag": "889d39d4-d8a9-413d-850d-667746898381"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:36.297401 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-0dc4e2e6-3c47-49d2-aff1-fc437d455001 req-e031e0b4-b0c7-499f-87d8-8a69266a25bf service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:36.298188 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-0dc4e2e6-3c47-49d2-aff1-fc437d455001 req-e031e0b4-b0c7-499f-87d8-8a69266a25bf service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:36.310063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-0dc4e2e6-3c47-49d2-aff1-fc437d455001 req-e031e0b4-b0c7-499f-87d8-8a69266a25bf service nova] Creating event network-changed:889d39d4-d8a9-413d-850d-667746898381 for instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b on hv-cinder-84349 May 26 18:22:36.320930 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-0dc4e2e6-3c47-49d2-aff1-fc437d455001 req-e031e0b4-b0c7-499f-87d8-8a69266a25bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036720 May 26 18:22:36.321832 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 296/599] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:36.341086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-97025b04-11c5-492e-8156-29f661b463b6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:36.342049 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-97025b04-11c5-492e-8156-29f661b463b6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:36.348747 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97025b04-11c5-492e-8156-29f661b463b6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:36.349412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97025b04-11c5-492e-8156-29f661b463b6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:36.350205 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97025b04-11c5-492e-8156-29f661b463b6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:36.350722 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97025b04-11c5-492e-8156-29f661b463b6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:36.357699 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0bf35390-9cb8-40f0-bd2a-7ea4c33f326d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:36.366809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0bf35390-9cb8-40f0-bd2a-7ea4c33f326d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1237 microversion: 2.1 time: 0.120435 May 26 18:22:36.367838 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 304/600] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:36 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1237 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:36.495845 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-97025b04-11c5-492e-8156-29f661b463b6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:36.503861 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-97025b04-11c5-492e-8156-29f661b463b6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1683 microversion: 2.1 time: 0.168425 May 26 18:22:36.504640 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 297/601] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:36 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:36.815256 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-706ea81a-9b3c-47c7-a67f-e9fec807bdee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:36.815925 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-706ea81a-9b3c-47c7-a67f-e9fec807bdee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:36.821945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-706ea81a-9b3c-47c7-a67f-e9fec807bdee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:36.822399 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-706ea81a-9b3c-47c7-a67f-e9fec807bdee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:36.823169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-706ea81a-9b3c-47c7-a67f-e9fec807bdee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:36.823602 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-706ea81a-9b3c-47c7-a67f-e9fec807bdee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:36.962737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-706ea81a-9b3c-47c7-a67f-e9fec807bdee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:36.970401 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-706ea81a-9b3c-47c7-a67f-e9fec807bdee tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1689 microversion: 2.1 time: 0.159047 May 26 18:22:36.970996 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 305/602] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:36 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:37.384976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-31120e30-8085-4313-878d-94ff2141c111 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:37.385684 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-31120e30-8085-4313-878d-94ff2141c111 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:37.392826 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-31120e30-8085-4313-878d-94ff2141c111 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.393397 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-31120e30-8085-4313-878d-94ff2141c111 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:37.394275 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-31120e30-8085-4313-878d-94ff2141c111 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.394783 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-31120e30-8085-4313-878d-94ff2141c111 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:37.457508 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-31120e30-8085-4313-878d-94ff2141c111 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:37.465955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-31120e30-8085-4313-878d-94ff2141c111 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1241 microversion: 2.1 time: 0.085702 May 26 18:22:37.466516 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 298/603] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:37 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:37.525031 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9f22037e-f3f7-4529-930b-069cefc67588 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:37.525680 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9f22037e-f3f7-4529-930b-069cefc67588 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:37.532134 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9f22037e-f3f7-4529-930b-069cefc67588 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.532586 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9f22037e-f3f7-4529-930b-069cefc67588 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:37.533351 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9f22037e-f3f7-4529-930b-069cefc67588 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.533812 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9f22037e-f3f7-4529-930b-069cefc67588 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:37.663656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9f22037e-f3f7-4529-930b-069cefc67588 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:37.671692 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9f22037e-f3f7-4529-930b-069cefc67588 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1683 microversion: 2.1 time: 0.150644 May 26 18:22:37.672262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 306/604] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:37 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:37.987520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5f60613f-626d-4194-b78c-fc8c9be153e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:37.988123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-5f60613f-626d-4194-b78c-fc8c9be153e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:37.994579 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f60613f-626d-4194-b78c-fc8c9be153e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.995029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f60613f-626d-4194-b78c-fc8c9be153e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:37.995789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f60613f-626d-4194-b78c-fc8c9be153e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.996537 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f60613f-626d-4194-b78c-fc8c9be153e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:38.125334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-5f60613f-626d-4194-b78c-fc8c9be153e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:38.132869 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5f60613f-626d-4194-b78c-fc8c9be153e4 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1689 microversion: 2.1 time: 0.149432 May 26 18:22:38.133434 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 299/605] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:37 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:38.483947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ff1ba09-9cd1-4e11-8ab4-1d60eb973e4b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:38.484613 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ff1ba09-9cd1-4e11-8ab4-1d60eb973e4b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:38.490902 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ff1ba09-9cd1-4e11-8ab4-1d60eb973e4b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:38.491490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ff1ba09-9cd1-4e11-8ab4-1d60eb973e4b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:38.492340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ff1ba09-9cd1-4e11-8ab4-1d60eb973e4b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:38.492874 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ff1ba09-9cd1-4e11-8ab4-1d60eb973e4b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:38.569478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ff1ba09-9cd1-4e11-8ab4-1d60eb973e4b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:38.577716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ff1ba09-9cd1-4e11-8ab4-1d60eb973e4b tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1289 microversion: 2.1 time: 0.097596 May 26 18:22:38.578697 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 307/606] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:38 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:38.696536 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-129503a1-11f5-4321-9735-ae3ca53945a7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:38.697166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-129503a1-11f5-4321-9735-ae3ca53945a7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:38.721354 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-129503a1-11f5-4321-9735-ae3ca53945a7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:38.723259 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-129503a1-11f5-4321-9735-ae3ca53945a7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:38.724307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-129503a1-11f5-4321-9735-ae3ca53945a7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:38.724914 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-129503a1-11f5-4321-9735-ae3ca53945a7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.144779 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-129503a1-11f5-4321-9735-ae3ca53945a7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:39.151399 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8191a8ef-1231-4590-a37c-11f69d488668 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:39.152119 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8191a8ef-1231-4590-a37c-11f69d488668 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:39.153347 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-129503a1-11f5-4321-9735-ae3ca53945a7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1683 microversion: 2.1 time: 0.467004 May 26 18:22:39.154164 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 300/607] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:38 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1683 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:39.158665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8191a8ef-1231-4590-a37c-11f69d488668 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:39.159428 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8191a8ef-1231-4590-a37c-11f69d488668 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.160692 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8191a8ef-1231-4590-a37c-11f69d488668 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:39.161346 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8191a8ef-1231-4590-a37c-11f69d488668 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.301936 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8191a8ef-1231-4590-a37c-11f69d488668 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:39.305764 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:39.311313 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8191a8ef-1231-4590-a37c-11f69d488668 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 200 len: 1621 microversion: 2.1 time: 0.165195 May 26 18:22:39.311902 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 308/608] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:39 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 1621 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:39.559150 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-cb0cc8b6-b7e1-4da5-8a58-1fd80e7193eb req-63b856ff-5caa-437c-9210-9a6914517b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97dd8752-9cc1-438c-830c-4f34e8c05fd6", "name": "network-vif-deleted", "tag": "baefe40e-bfcc-4cf6-bbb3-6273d240e5d0"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:39.568373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-cb0cc8b6-b7e1-4da5-8a58-1fd80e7193eb req-63b856ff-5caa-437c-9210-9a6914517b4f service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:39.569059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-cb0cc8b6-b7e1-4da5-8a58-1fd80e7193eb req-63b856ff-5caa-437c-9210-9a6914517b4f service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.588587 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-cb0cc8b6-b7e1-4da5-8a58-1fd80e7193eb req-63b856ff-5caa-437c-9210-9a6914517b4f service nova] Creating event network-vif-deleted:baefe40e-bfcc-4cf6-bbb3-6273d240e5d0 for instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 on hv-cinder-84349 May 26 18:22:39.595731 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e16bfaf0-366d-4e42-9d55-465545e91626 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:39.597259 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e16bfaf0-366d-4e42-9d55-465545e91626 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:39.620950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e16bfaf0-366d-4e42-9d55-465545e91626 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:39.623523 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-cb0cc8b6-b7e1-4da5-8a58-1fd80e7193eb req-63b856ff-5caa-437c-9210-9a6914517b4f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068913 May 26 18:22:39.633174 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 301/609] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:39.634007 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e16bfaf0-366d-4e42-9d55-465545e91626 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.636480 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e16bfaf0-366d-4e42-9d55-465545e91626 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:39.639718 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e16bfaf0-366d-4e42-9d55-465545e91626 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:40.085011 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e16bfaf0-366d-4e42-9d55-465545e91626 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:40.102492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e16bfaf0-366d-4e42-9d55-465545e91626 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1295 microversion: 2.1 time: 0.510874 May 26 18:22:40.121832 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 309/610] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:39 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1295 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:40.174552 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-418d9f64-209d-4cca-8f5f-3151f27ddec6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:40.175518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-418d9f64-209d-4cca-8f5f-3151f27ddec6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:40.194423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-418d9f64-209d-4cca-8f5f-3151f27ddec6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:40.196613 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-418d9f64-209d-4cca-8f5f-3151f27ddec6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:40.200399 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-418d9f64-209d-4cca-8f5f-3151f27ddec6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:40.201193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-418d9f64-209d-4cca-8f5f-3151f27ddec6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:40.328378 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:40.329245 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 97dd8752-9cc1-438c-830c-4f34e8c05fd6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:40.338865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:40.340048 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:40.341260 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:40.341891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:40.359087 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] HTTP exception thrown: Instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 could not be found. May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Request method failure captured: May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 HTTP/1.1 May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RWODLYi3wdaspll1zSy4mFYh46s3GN57iRM-L_-oq2PC7kcMeh3vdvzheNADnGzneVMfEKJQD3fIE7UbLMCCJH1QIAx7okekyzdCgqUMi23a9gOm7NEbdM2gUEcXOy9FAQIbx6XMUkM4IF8RynHZWEW4I9HmMmXTcFriT68BGeYPA May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:22:40.361382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5cb09766b9784d50aad144d466a5d050", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 3b3f8de4a3b54d58806506b827cfa89a May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 could not be found. May 26 18:22:40.363157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '97dd8752-9cc1-438c-830c-4f34e8c05fd6'} May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 could not be found. May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:40.364030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 could not be found. May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 could not be found. May 26 18:22:40.366049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:22:40.369263 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Returning 404 to user: Instance 97dd8752-9cc1-438c-830c-4f34e8c05fd6 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:40.371302 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5235c656-6168-48f0-9ede-28bb8949be9b tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6" status: 404 len: 111 microversion: 2.1 time: 0.046234 May 26 18:22:40.372031 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 310/611] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:40 2022] GET /compute/v2.1/servers/97dd8752-9cc1-438c-830c-4f34e8c05fd6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:22:40.381439 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7e251e85-5761-4b87-8bfe-c1a9b39e3144 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '.version_select at 0x7f5f183b91f0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:40.407785 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7e251e85-5761-4b87-8bfe-c1a9b39e3144 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643309950" status: 202 len: 0 microversion: 2.1 time: 0.031078 May 26 18:22:40.410098 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 311/612] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 18:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643309950 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:22:40.422073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-2cd8da3e-8642-41df-a373-e8fee651829c req-77b7d1bd-4f28-4f88-9c0a-c3e482113069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e1d369-3bad-49f8-8830-1f1206e60780", "name": "network-vif-deleted", "tag": "2fbeda35-35e5-4278-a0b7-b2cfe145869c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:40.458167 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-2cd8da3e-8642-41df-a373-e8fee651829c req-77b7d1bd-4f28-4f88-9c0a-c3e482113069 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:40.458950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-2cd8da3e-8642-41df-a373-e8fee651829c req-77b7d1bd-4f28-4f88-9c0a-c3e482113069 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:40.486052 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-2cd8da3e-8642-41df-a373-e8fee651829c req-77b7d1bd-4f28-4f88-9c0a-c3e482113069 service nova] Creating event network-vif-deleted:2fbeda35-35e5-4278-a0b7-b2cfe145869c for instance f5e1d369-3bad-49f8-8830-1f1206e60780 on hv-cinder-84349 May 26 18:22:40.493197 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-2cd8da3e-8642-41df-a373-e8fee651829c req-77b7d1bd-4f28-4f88-9c0a-c3e482113069 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078979 May 26 18:22:40.495617 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 312/613] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:40.798099 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-418d9f64-209d-4cca-8f5f-3151f27ddec6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:40.810077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-418d9f64-209d-4cca-8f5f-3151f27ddec6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 200 len: 1615 microversion: 2.1 time: 0.642031 May 26 18:22:40.810673 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 302/614] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:40 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 1615 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:41.123300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7cd53bd1-cfaf-4086-bfef-6c1c0ccff148 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:41.124161 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7cd53bd1-cfaf-4086-bfef-6c1c0ccff148 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:41.138198 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7cd53bd1-cfaf-4086-bfef-6c1c0ccff148 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:41.140478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7cd53bd1-cfaf-4086-bfef-6c1c0ccff148 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:41.141518 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7cd53bd1-cfaf-4086-bfef-6c1c0ccff148 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:41.143244 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7cd53bd1-cfaf-4086-bfef-6c1c0ccff148 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:41.438984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7cd53bd1-cfaf-4086-bfef-6c1c0ccff148 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:41.454454 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7cd53bd1-cfaf-4086-bfef-6c1c0ccff148 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1362 microversion: 2.1 time: 0.337133 May 26 18:22:41.463526 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 313/615] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:41 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:41.828119 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:41.828669 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:41.837076 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:41.838066 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:41.839263 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:41.839761 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:41.863648 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 HTTP/1.1 May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:22:41.867970 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:22:41.870635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'f5e1d369-3bad-49f8-8830-1f1206e60780'} May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:41.871564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:22:41.872948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:41.874928 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:41.874928 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b2725be5-085b-4978-9489-6fe79699383f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 404 len: 111 microversion: 2.1 time: 0.047410 May 26 18:22:41.874928 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 303/616] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:41 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:22:41.882930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6e5ad947-2ce6-4f21-a748-960ef096536e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '.version_select at 0x7f5f183b9820>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:41.898511 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:41.910030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6e5ad947-2ce6-4f21-a748-960ef096536e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1761058089" status: 202 len: 0 microversion: 2.1 time: 0.031569 May 26 18:22:41.911353 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 314/617] 10.222.0.46 () {58 vars in 1220 bytes} [Thu May 26 18:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1761058089 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:22:42.198102 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9f207a06-834f-4191-ac7e-42a229fc4f72 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-176781714"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:42.198756 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9f207a06-834f-4191-ac7e-42a229fc4f72 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:42.204790 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9f207a06-834f-4191-ac7e-42a229fc4f72 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:42.205304 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9f207a06-834f-4191-ac7e-42a229fc4f72 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:42.206712 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9f207a06-834f-4191-ac7e-42a229fc4f72 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:42.207151 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9f207a06-834f-4191-ac7e-42a229fc4f72 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:42.403504 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.network.security_group_api [None req-9f207a06-834f-4191-ac7e-42a229fc4f72 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Removing security group 4f9cbdde-e96f-4bcd-91e0-e81c8dd4b618 from port c471eca6-7897-4bd4-980d-b46e7fcc2133 May 26 18:22:42.476547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-73ae8340-d405-4f34-8272-e179703199c5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:42.478585 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-73ae8340-d405-4f34-8272-e179703199c5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:42.485782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73ae8340-d405-4f34-8272-e179703199c5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:42.486243 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73ae8340-d405-4f34-8272-e179703199c5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:42.487059 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73ae8340-d405-4f34-8272-e179703199c5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:42.487651 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73ae8340-d405-4f34-8272-e179703199c5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:42.715761 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-73ae8340-d405-4f34-8272-e179703199c5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:42.724175 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-73ae8340-d405-4f34-8272-e179703199c5 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1362 microversion: 2.1 time: 0.252163 May 26 18:22:42.724762 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 315/618] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:42 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:42.730348 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-c8bd0ed9-321d-45b4-8c02-417688bf4877 req-90c8b1ce-3ba0-4c8f-bf4a-6fefc0d07c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34599fe-7096-4f0a-a115-f975c3cbee2c", "tag": "17b9f864-286f-441e-acbd-070ab315d197"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:42.738832 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-c8bd0ed9-321d-45b4-8c02-417688bf4877 req-90c8b1ce-3ba0-4c8f-bf4a-6fefc0d07c5c service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:42.739269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-c8bd0ed9-321d-45b4-8c02-417688bf4877 req-90c8b1ce-3ba0-4c8f-bf4a-6fefc0d07c5c service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:42.751027 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-c8bd0ed9-321d-45b4-8c02-417688bf4877 req-90c8b1ce-3ba0-4c8f-bf4a-6fefc0d07c5c service nova] Creating event network-changed:17b9f864-286f-441e-acbd-070ab315d197 for instance d34599fe-7096-4f0a-a115-f975c3cbee2c on hv-cinder-84349 May 26 18:22:42.756027 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-c8bd0ed9-321d-45b4-8c02-417688bf4877 req-90c8b1ce-3ba0-4c8f-bf4a-6fefc0d07c5c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029959 May 26 18:22:42.756821 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 316/619] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:42.764027 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e66dd9e4-0f86-408e-98f4-bf61b8f7aa5e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: .version_select at 0x7f5f18538040>, body: {"keypair": {"name": "tempest-keypair-2101224730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxoOAM9gT/HNd7kIwaKnb8xniRJSc4W6dNoJM9BnqKY17bVm2SIc0Q20YhATkRDCtqj5DQTrY5svH3DoJRUvh/1rtG8jsyfYczAl9zzYrDScLwJFqkkUK51fjx3pp4Trg=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:42.782395 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-e66dd9e4-0f86-408e-98f4-bf61b8f7aa5e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:22:42.786078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-e66dd9e4-0f86-408e-98f4-bf61b8f7aa5e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for user 8da0a5a09a6041d68c5e445af1a492f3 and project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:22:42.814924 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e66dd9e4-0f86-408e-98f4-bf61b8f7aa5e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057076 May 26 18:22:42.815783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 317/620] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:22:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:42.919953 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9f207a06-834f-4191-ac7e-42a229fc4f72 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "POST /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/action" status: 202 len: 0 microversion: 2.1 time: 0.726028 May 26 18:22:42.920581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 304/621] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:22:42 2022] POST /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:22:43.742459 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-23ab8bde-efe4-4888-b1f0-d25e5bc21881 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:43.743711 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-23ab8bde-efe4-4888-b1f0-d25e5bc21881 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:43.750039 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23ab8bde-efe4-4888-b1f0-d25e5bc21881 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:43.750814 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23ab8bde-efe4-4888-b1f0-d25e5bc21881 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:43.751688 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23ab8bde-efe4-4888-b1f0-d25e5bc21881 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:43.752197 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23ab8bde-efe4-4888-b1f0-d25e5bc21881 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:43.833242 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e6600b88-eb1e-41a1-ae05-d336d57f91bc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:43.833860 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e6600b88-eb1e-41a1-ae05-d336d57f91bc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:43.841404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e6600b88-eb1e-41a1-ae05-d336d57f91bc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:43.841992 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e6600b88-eb1e-41a1-ae05-d336d57f91bc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:43.842835 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e6600b88-eb1e-41a1-ae05-d336d57f91bc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:43.843449 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e6600b88-eb1e-41a1-ae05-d336d57f91bc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:43.869995 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e6600b88-eb1e-41a1-ae05-d336d57f91bc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:22:43.897187 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:43.952731 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e6600b88-eb1e-41a1-ae05-d336d57f91bc tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 204 len: 0 microversion: 2.1 time: 0.123415 May 26 18:22:43.954935 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 305/622] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:22:43 2022] DELETE /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:22:43.965451 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6589e73c-bd99-4e22-90bc-f833b72c9881 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:43.966997 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6589e73c-bd99-4e22-90bc-f833b72c9881 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:43.974250 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6589e73c-bd99-4e22-90bc-f833b72c9881 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:43.974656 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6589e73c-bd99-4e22-90bc-f833b72c9881 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:43.975416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6589e73c-bd99-4e22-90bc-f833b72c9881 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:43.976027 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6589e73c-bd99-4e22-90bc-f833b72c9881 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.091190 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-23ab8bde-efe4-4888-b1f0-d25e5bc21881 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:44.098811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-23ab8bde-efe4-4888-b1f0-d25e5bc21881 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1362 microversion: 2.1 time: 0.360729 May 26 18:22:44.099362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 318/623] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:43 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:44.236005 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6589e73c-bd99-4e22-90bc-f833b72c9881 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:44.248879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6589e73c-bd99-4e22-90bc-f833b72c9881 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1509 microversion: 2.1 time: 0.289563 May 26 18:22:44.249481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 306/624] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:43 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:44.411500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f32f3c0f-290f-4ac4-8918-2199c3291243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:44.412033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f32f3c0f-290f-4ac4-8918-2199c3291243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:44.412945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-e043a758-6554-4132-96a2-fbbfe3965d74 req-39d2ce9c-69c6-4405-8e06-c41f490e7b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37c198f-b170-4773-8436-c52a8d5b934b", "tag": "c471eca6-7897-4bd4-980d-b46e7fcc2133"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:44.419645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f32f3c0f-290f-4ac4-8918-2199c3291243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:44.420344 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f32f3c0f-290f-4ac4-8918-2199c3291243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.421285 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f32f3c0f-290f-4ac4-8918-2199c3291243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:44.421941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f32f3c0f-290f-4ac4-8918-2199c3291243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.422307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-e043a758-6554-4132-96a2-fbbfe3965d74 req-39d2ce9c-69c6-4405-8e06-c41f490e7b40 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:44.422949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-e043a758-6554-4132-96a2-fbbfe3965d74 req-39d2ce9c-69c6-4405-8e06-c41f490e7b40 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.435570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-e043a758-6554-4132-96a2-fbbfe3965d74 req-39d2ce9c-69c6-4405-8e06-c41f490e7b40 service nova] Creating event network-changed:c471eca6-7897-4bd4-980d-b46e7fcc2133 for instance b37c198f-b170-4773-8436-c52a8d5b934b on hv-cinder-84349 May 26 18:22:44.442289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-e043a758-6554-4132-96a2-fbbfe3965d74 req-39d2ce9c-69c6-4405-8e06-c41f490e7b40 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032829 May 26 18:22:44.443482 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 307/625] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:44.527129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-f32f3c0f-290f-4ac4-8918-2199c3291243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lazy-loading 'services' on Instance uuid b37c198f-b170-4773-8436-c52a8d5b934b {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:44.619209 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f32f3c0f-290f-4ac4-8918-2199c3291243 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments/eee07d41-1c97-49e6-891e-e74a6a585cc9" status: 202 len: 0 microversion: 2.1 time: 0.211793 May 26 18:22:44.620509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 319/626] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:22:44 2022] DELETE /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments/eee07d41-1c97-49e6-891e-e74a6a585cc9 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:22:44.629141 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9541a08f-15b8-467e-87be-2503664f4cfd tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:44.630192 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9541a08f-15b8-467e-87be-2503664f4cfd tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:44.637546 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9541a08f-15b8-467e-87be-2503664f4cfd tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:44.638037 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9541a08f-15b8-467e-87be-2503664f4cfd tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.638810 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9541a08f-15b8-467e-87be-2503664f4cfd tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:44.639248 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9541a08f-15b8-467e-87be-2503664f4cfd tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.670045 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9541a08f-15b8-467e-87be-2503664f4cfd tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 May 26 18:22:44.670663 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 308/627] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:44 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:44.792743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-10646206-3c4c-4cb0-9465-bbed0bdeadb4 req-bdf29901-76fd-4d3d-a299-b65c9616f6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37c198f-b170-4773-8436-c52a8d5b934b", "tag": "c471eca6-7897-4bd4-980d-b46e7fcc2133"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:44.804500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-10646206-3c4c-4cb0-9465-bbed0bdeadb4 req-bdf29901-76fd-4d3d-a299-b65c9616f6d5 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:44.805006 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-10646206-3c4c-4cb0-9465-bbed0bdeadb4 req-bdf29901-76fd-4d3d-a299-b65c9616f6d5 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.820355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-10646206-3c4c-4cb0-9465-bbed0bdeadb4 req-bdf29901-76fd-4d3d-a299-b65c9616f6d5 service nova] Creating event network-changed:c471eca6-7897-4bd4-980d-b46e7fcc2133 for instance b37c198f-b170-4773-8436-c52a8d5b934b on hv-cinder-84349 May 26 18:22:44.826500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-10646206-3c4c-4cb0-9465-bbed0bdeadb4 req-bdf29901-76fd-4d3d-a299-b65c9616f6d5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040481 May 26 18:22:44.827094 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 320/628] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:44.879186 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-134499137", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a9ad5fd-79c8-4cd5-b5bd-a36ef382cf69"}], "security_groups": [{"name": "tempest-securitygroup--159947183"}], "key_name": "tempest-keypair-2101224730", "user_data": "}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:44.987857 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] validate_networks() for [('8a9ad5fd-79c8-4cd5-b5bd-a36ef382cf69', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:22:45.119608 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e33a97cf-4b96-432f-8ff3-03929fb836f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:45.120443 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e33a97cf-4b96-432f-8ff3-03929fb836f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:45.127302 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e33a97cf-4b96-432f-8ff3-03929fb836f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.127877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e33a97cf-4b96-432f-8ff3-03929fb836f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.128740 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e33a97cf-4b96-432f-8ff3-03929fb836f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.129297 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e33a97cf-4b96-432f-8ff3-03929fb836f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.339074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e33a97cf-4b96-432f-8ff3-03929fb836f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:45.350787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e33a97cf-4b96-432f-8ff3-03929fb836f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1362 microversion: 2.1 time: 0.237702 May 26 18:22:45.360604 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 321/629] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:45 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:45.364256 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-71f3a729-d98c-4637-9c1c-469afbfd1705 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:45.364874 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-71f3a729-d98c-4637-9c1c-469afbfd1705 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:45.371888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71f3a729-d98c-4637-9c1c-469afbfd1705 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.372336 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71f3a729-d98c-4637-9c1c-469afbfd1705 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.373156 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71f3a729-d98c-4637-9c1c-469afbfd1705 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.373809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-71f3a729-d98c-4637-9c1c-469afbfd1705 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.529613 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:22:45.530352 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:22:45.531339 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:22:45.532667 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:22:45.533448 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:22:45.546446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.547166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.548139 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.548755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.559741 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-71f3a729-d98c-4637-9c1c-469afbfd1705 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:45.570011 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-71f3a729-d98c-4637-9c1c-469afbfd1705 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1509 microversion: 2.1 time: 0.217350 May 26 18:22:45.570609 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 322/630] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:45 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:45.575542 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:22:45.581625 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Getting quotas for user 8da0a5a09a6041d68c5e445af1a492f3 and project 31b4afa4107c4cd2ac0212c45d998801. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:22:45.594579 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:22:45.596879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:22:45.644330 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-584755b3-9a38-46c4-9ffb-08a972d5c14f tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.769567 May 26 18:22:45.645087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 309/631] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:22:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:22:45.656814 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-14c371b2-9f96-4bdc-b21d-6e20e85b2a2d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:45.657807 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-14c371b2-9f96-4bdc-b21d-6e20e85b2a2d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:45.689828 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-977760ee-7016-4272-aac0-63b78cd2057f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:45.691740 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-977760ee-7016-4272-aac0-63b78cd2057f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:45.700917 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-977760ee-7016-4272-aac0-63b78cd2057f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.701375 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-977760ee-7016-4272-aac0-63b78cd2057f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.702331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-977760ee-7016-4272-aac0-63b78cd2057f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.703048 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-977760ee-7016-4272-aac0-63b78cd2057f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.740213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-977760ee-7016-4272-aac0-63b78cd2057f tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061883 May 26 18:22:45.745368 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 310/632] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:45 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:45.801496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-14c371b2-9f96-4bdc-b21d-6e20e85b2a2d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:45.809021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-14c371b2-9f96-4bdc-b21d-6e20e85b2a2d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1241 microversion: 2.1 time: 0.156917 May 26 18:22:45.810054 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 323/633] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:45 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:46.367910 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a1b2027d-c29a-4ec5-b93c-85652866a7b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:46.369018 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a1b2027d-c29a-4ec5-b93c-85652866a7b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:46.375481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a1b2027d-c29a-4ec5-b93c-85652866a7b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.375922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a1b2027d-c29a-4ec5-b93c-85652866a7b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.376670 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a1b2027d-c29a-4ec5-b93c-85652866a7b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.377101 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a1b2027d-c29a-4ec5-b93c-85652866a7b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.504008 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a1b2027d-c29a-4ec5-b93c-85652866a7b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:46.512364 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a1b2027d-c29a-4ec5-b93c-85652866a7b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1362 microversion: 2.1 time: 0.148101 May 26 18:22:46.512941 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 311/634] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:46 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:46.586899 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5ba6c662-eff9-4f70-9ae2-6b60aa991e54 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:46.588928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5ba6c662-eff9-4f70-9ae2-6b60aa991e54 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:46.607246 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ba6c662-eff9-4f70-9ae2-6b60aa991e54 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.607802 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ba6c662-eff9-4f70-9ae2-6b60aa991e54 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.608665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ba6c662-eff9-4f70-9ae2-6b60aa991e54 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.609174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5ba6c662-eff9-4f70-9ae2-6b60aa991e54 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.753289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5d59f0d3-87ba-4396-80ef-10109fe73e3b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:46.754679 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-5d59f0d3-87ba-4396-80ef-10109fe73e3b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:46.763606 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5d59f0d3-87ba-4396-80ef-10109fe73e3b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.764422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5d59f0d3-87ba-4396-80ef-10109fe73e3b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.765841 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5d59f0d3-87ba-4396-80ef-10109fe73e3b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.767302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5d59f0d3-87ba-4396-80ef-10109fe73e3b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.808751 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5d59f0d3-87ba-4396-80ef-10109fe73e3b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059932 May 26 18:22:46.809541 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 312/635] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:46 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:46.825909 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7bc15457-7f65-447b-8fbe-bdfd1d482f5b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:46.826420 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7bc15457-7f65-447b-8fbe-bdfd1d482f5b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:46.832726 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7bc15457-7f65-447b-8fbe-bdfd1d482f5b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.833168 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7bc15457-7f65-447b-8fbe-bdfd1d482f5b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.833968 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7bc15457-7f65-447b-8fbe-bdfd1d482f5b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.834402 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7bc15457-7f65-447b-8fbe-bdfd1d482f5b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.090441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7bc15457-7f65-447b-8fbe-bdfd1d482f5b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:47.102832 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7bc15457-7f65-447b-8fbe-bdfd1d482f5b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1237 microversion: 2.1 time: 0.281264 May 26 18:22:47.104092 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 313/636] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:46 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1237 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:47.171029 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5ba6c662-eff9-4f70-9ae2-6b60aa991e54 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:47.181416 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5ba6c662-eff9-4f70-9ae2-6b60aa991e54 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1509 microversion: 2.1 time: 0.597681 May 26 18:22:47.183117 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 324/637] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:46 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1509 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:47.529502 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-de585fd2-28d2-46e3-8bd4-8ef8a6c32070 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:47.530049 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-de585fd2-28d2-46e3-8bd4-8ef8a6c32070 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:47.538308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de585fd2-28d2-46e3-8bd4-8ef8a6c32070 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.538945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de585fd2-28d2-46e3-8bd4-8ef8a6c32070 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.539859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de585fd2-28d2-46e3-8bd4-8ef8a6c32070 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.541302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de585fd2-28d2-46e3-8bd4-8ef8a6c32070 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.738605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-5207c946-48cf-4753-b28e-2a6a183e9fcb req-338ed593-ceae-4eed-862a-525a76a38440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5318d4c9-f954-4123-b0ce-d2b418f37dd3", "name": "network-vif-deleted", "tag": "e97a903b-46cf-40f9-9aed-884e6e491c98"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:47.747061 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-5207c946-48cf-4753-b28e-2a6a183e9fcb req-338ed593-ceae-4eed-862a-525a76a38440 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.747498 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-5207c946-48cf-4753-b28e-2a6a183e9fcb req-338ed593-ceae-4eed-862a-525a76a38440 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.759730 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-5207c946-48cf-4753-b28e-2a6a183e9fcb req-338ed593-ceae-4eed-862a-525a76a38440 service nova] Creating event network-vif-deleted:e97a903b-46cf-40f9-9aed-884e6e491c98 for instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 on hv-cinder-84349 May 26 18:22:47.770821 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-5207c946-48cf-4753-b28e-2a6a183e9fcb req-338ed593-ceae-4eed-862a-525a76a38440 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035970 May 26 18:22:47.771758 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 325/638] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:47.821404 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f7f7c5c1-5de1-4834-afe1-391195180ad3 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:47.822839 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f7f7c5c1-5de1-4834-afe1-391195180ad3 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:47.830699 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7f7c5c1-5de1-4834-afe1-391195180ad3 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.831316 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7f7c5c1-5de1-4834-afe1-391195180ad3 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.832173 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7f7c5c1-5de1-4834-afe1-391195180ad3 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.832702 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f7f7c5c1-5de1-4834-afe1-391195180ad3 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.867799 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-de585fd2-28d2-46e3-8bd4-8ef8a6c32070 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:47.882840 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-de585fd2-28d2-46e3-8bd4-8ef8a6c32070 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1362 microversion: 2.1 time: 0.357063 May 26 18:22:47.887105 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f7f7c5c1-5de1-4834-afe1-391195180ad3 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070115 May 26 18:22:47.888259 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 326/639] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:22:47 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:22:47.895819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 314/640] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:47 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:47.901492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-54f8d765-5a58-4d00-bdaf-aa9259e1f2fb req-afe6821d-b735-4db0-861e-f883bd1c13b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34599fe-7096-4f0a-a115-f975c3cbee2c", "name": "network-vif-plugged", "status": "completed", "tag": "17b9f864-286f-441e-acbd-070ab315d197"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:47.902720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:47.903785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:47.917273 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-54f8d765-5a58-4d00-bdaf-aa9259e1f2fb req-afe6821d-b735-4db0-861e-f883bd1c13b5 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.918257 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-54f8d765-5a58-4d00-bdaf-aa9259e1f2fb req-afe6821d-b735-4db0-861e-f883bd1c13b5 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.922120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.923674 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.924470 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.925324 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.946161 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-54f8d765-5a58-4d00-bdaf-aa9259e1f2fb req-afe6821d-b735-4db0-861e-f883bd1c13b5 service nova] Creating event network-vif-plugged:17b9f864-286f-441e-acbd-070ab315d197 for instance d34599fe-7096-4f0a-a115-f975c3cbee2c on hv-cinder-84349 May 26 18:22:47.954957 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-54f8d765-5a58-4d00-bdaf-aa9259e1f2fb req-afe6821d-b735-4db0-861e-f883bd1c13b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062578 May 26 18:22:47.957192 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 327/641] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:48.074184 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] HTTP exception thrown: Instance b37c198f-b170-4773-8436-c52a8d5b934b is not attached to volume eee07d41-1c97-49e6-891e-e74a6a585cc9 May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Request method failure captured: May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: DELETE /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments/eee07d41-1c97-49e6-891e-e74a6a585cc9 HTTP/1.1 May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8TAkWL0PdfXyAihYysUx1d7xyeI2IaKvI7C5XEhMozWjX4mK-wgCRpHDGOt_1VI7BFpnPcSAgu-OfmpCiax8yDIDjrqplpg2iNfO5kGZfPEIp6KpWboaxLOBC2A2bEIb5wBNbz1SypjpxHWtK2eTWPWvgpQ1P-G8dKiX4QZ_wiEGs8 May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: d08521617c884fe9a67609887f0ddaae May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-TestMinimumBasicScenario-1676833738 May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:22:48.082727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d08521617c884fe9a67609887f0ddaae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d08521617c884fe9a67609887f0ddaae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d08521617c884fe9a67609887f0ddaae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d08521617c884fe9a67609887f0ddaae", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-TestMinimumBasicScenario-1676833738 May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: d08521617c884fe9a67609887f0ddaae May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1676833738 May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-TestMinimumBasicScenario-1676833738-project May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 5462b6a8d72749b9a07cd52ff8cb29d1 May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-TestMinimumBasicScenario-1676833738-project May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:22:48.084302 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance b37c198f-b170-4773-8436-c52a8d5b934b is not attached to volume eee07d41-1c97-49e6-891e-e74a6a585cc9 May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'server_id': 'b37c198f-b170-4773-8436-c52a8d5b934b', 'id': 'eee07d41-1c97-49e6-891e-e74a6a585cc9'} May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eee07d41-1c97-49e6-891e-e74a6a585cc9. May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:48.085108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b37c198f-b170-4773-8436-c52a8d5b934b is not attached to volume eee07d41-1c97-49e6-891e-e74a6a585cc9 May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b37c198f-b170-4773-8436-c52a8d5b934b is not attached to volume eee07d41-1c97-49e6-891e-e74a6a585cc9 May 26 18:22:48.086416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:48.091691 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Returning 404 to user: Instance b37c198f-b170-4773-8436-c52a8d5b934b is not attached to volume eee07d41-1c97-49e6-891e-e74a6a585cc9 {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:48.092983 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c5ba40a4-ddb9-4617-a544-08cfe94373fb tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments/eee07d41-1c97-49e6-891e-e74a6a585cc9" status: 404 len: 154 microversion: 2.1 time: 0.195795 May 26 18:22:48.093767 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 315/642] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:22:47 2022] DELETE /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b/os-volume_attachments/eee07d41-1c97-49e6-891e-e74a6a585cc9 => generated 154 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:22:48.122578 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8cfd56ff-a48f-4b97-a3da-e90c7e6bc3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:48.123290 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8cfd56ff-a48f-4b97-a3da-e90c7e6bc3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:48.132465 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cfd56ff-a48f-4b97-a3da-e90c7e6bc3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:48.133038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cfd56ff-a48f-4b97-a3da-e90c7e6bc3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:48.134317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cfd56ff-a48f-4b97-a3da-e90c7e6bc3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:48.134972 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8cfd56ff-a48f-4b97-a3da-e90c7e6bc3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:48.201378 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:48.202334 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:48.208651 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:48.209381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:48.210301 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:48.210951 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:48.223384 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8cfd56ff-a48f-4b97-a3da-e90c7e6bc3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:48.234589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8cfd56ff-a48f-4b97-a3da-e90c7e6bc3ba tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1299 microversion: 2.1 time: 0.117099 May 26 18:22:48.235763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 328/643] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:48 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:48.263071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:48.263971 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:48.265115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lazy-loading 'fault' on Instance uuid 5318d4c9-f954-4123-b0ce-d2b418f37dd3 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:48.402001 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:48.409860 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f4cf4eb8-1fa2-496e-b158-e05b5b443a7f tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 200 len: 1312 microversion: 2.1 time: 0.214992 May 26 18:22:48.410929 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 316/644] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:48 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:48.901075 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-acc0cf6b-6708-4b97-bab4-135bf4af8291 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:48.902113 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-acc0cf6b-6708-4b97-bab4-135bf4af8291 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:48.908796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-acc0cf6b-6708-4b97-bab4-135bf4af8291 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:48.909342 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-acc0cf6b-6708-4b97-bab4-135bf4af8291 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:48.910221 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-acc0cf6b-6708-4b97-bab4-135bf4af8291 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:48.910871 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-acc0cf6b-6708-4b97-bab4-135bf4af8291 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.089527 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-acc0cf6b-6708-4b97-bab4-135bf4af8291 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:49.096967 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-acc0cf6b-6708-4b97-bab4-135bf4af8291 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1362 microversion: 2.1 time: 0.200371 May 26 18:22:49.097544 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 329/645] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:48 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:49.252488 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c00a3d4c-7ae3-41c8-9b5e-51d4f82d11e6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:49.252984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3bb3105c-99e5-4eae-a5f6-f8b042ba85c6 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:49.253354 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c00a3d4c-7ae3-41c8-9b5e-51d4f82d11e6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:49.253451 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3bb3105c-99e5-4eae-a5f6-f8b042ba85c6 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:49.260001 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3bb3105c-99e5-4eae-a5f6-f8b042ba85c6 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.260391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c00a3d4c-7ae3-41c8-9b5e-51d4f82d11e6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.260727 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3bb3105c-99e5-4eae-a5f6-f8b042ba85c6 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.260852 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c00a3d4c-7ae3-41c8-9b5e-51d4f82d11e6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.261630 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c00a3d4c-7ae3-41c8-9b5e-51d4f82d11e6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.261917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3bb3105c-99e5-4eae-a5f6-f8b042ba85c6 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.262097 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c00a3d4c-7ae3-41c8-9b5e-51d4f82d11e6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.262555 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3bb3105c-99e5-4eae-a5f6-f8b042ba85c6 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.288393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3bb3105c-99e5-4eae-a5f6-f8b042ba85c6 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:22:49.372845 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3bb3105c-99e5-4eae-a5f6-f8b042ba85c6 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 204 len: 0 microversion: 2.1 time: 0.122892 May 26 18:22:49.373862 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 330/646] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:22:49 2022] DELETE /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:22:49.384434 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-12ddfbb0-a6a0-455c-93ef-4681e0114325 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:49.385599 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-12ddfbb0-a6a0-455c-93ef-4681e0114325 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:49.393656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-12ddfbb0-a6a0-455c-93ef-4681e0114325 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.394145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-12ddfbb0-a6a0-455c-93ef-4681e0114325 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.395380 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-12ddfbb0-a6a0-455c-93ef-4681e0114325 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.396097 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-12ddfbb0-a6a0-455c-93ef-4681e0114325 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.403662 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:49.617902 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c00a3d4c-7ae3-41c8-9b5e-51d4f82d11e6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:49.626099 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c00a3d4c-7ae3-41c8-9b5e-51d4f82d11e6 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.377440 May 26 18:22:49.626607 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 317/647] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:49 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:49.631094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:49.631697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: 5318d4c9-f954-4123-b0ce-d2b418f37dd3] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:49.638002 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.638496 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.639265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.639701 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.652812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] HTTP exception thrown: Instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 could not be found. May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Request method failure captured: May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 HTTP/1.1 May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RWODLYi3wdaspll1zSy4mFYh46s3GN57iRM-L_-oq2PC7kcMeh3vdvzheNADnGzneVMfEKJQD3fIE7UbLMCCJH1QIAx7okekyzdCgqUMi23a9gOm7NEbdM2gUEcXOy9FAQIbx6XMUkM4IF8RynHZWEW4I9HmMmXTcFriT68BGeYPA May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:22:49.654394 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5cb09766b9784d50aad144d466a5d050", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 3b3f8de4a3b54d58806506b827cfa89a May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 could not be found. May 26 18:22:49.655762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '5318d4c9-f954-4123-b0ce-d2b418f37dd3'} May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 could not be found. May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:49.656469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 could not be found. May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 could not be found. May 26 18:22:49.657609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:49.658725 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Returning 404 to user: Instance 5318d4c9-f954-4123-b0ce-d2b418f37dd3 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:49.658725 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ba35da6f-c28d-419a-bc80-4aadafe56280 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3" status: 404 len: 111 microversion: 2.1 time: 0.028235 May 26 18:22:49.658725 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 318/648] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:49 2022] GET /compute/v2.1/servers/5318d4c9-f954-4123-b0ce-d2b418f37dd3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:22:49.664045 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4648aae1-e655-437d-b085-5635173076b9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:49.664566 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4648aae1-e655-437d-b085-5635173076b9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:49.670946 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4648aae1-e655-437d-b085-5635173076b9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.671397 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4648aae1-e655-437d-b085-5635173076b9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.672169 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4648aae1-e655-437d-b085-5635173076b9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.672726 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4648aae1-e655-437d-b085-5635173076b9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.679898 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-12ddfbb0-a6a0-455c-93ef-4681e0114325 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:49.688324 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-12ddfbb0-a6a0-455c-93ef-4681e0114325 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1554 microversion: 2.1 time: 0.309215 May 26 18:22:49.688995 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 331/649] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:49 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1554 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:49.703150 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4648aae1-e655-437d-b085-5635173076b9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:22:49.782195 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:49.789367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4648aae1-e655-437d-b085-5635173076b9 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 204 len: 0 microversion: 2.1 time: 0.128646 May 26 18:22:49.793808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 319/650] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:22:49 2022] DELETE /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:22:49.799115 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-178f68fd-0b33-4dcc-8a98-8b7182810f51 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:49.799820 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-178f68fd-0b33-4dcc-8a98-8b7182810f51 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:49.807646 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-178f68fd-0b33-4dcc-8a98-8b7182810f51 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.808101 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-178f68fd-0b33-4dcc-8a98-8b7182810f51 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:49.809695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-178f68fd-0b33-4dcc-8a98-8b7182810f51 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:49.810165 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-178f68fd-0b33-4dcc-8a98-8b7182810f51 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:50.004857 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-178f68fd-0b33-4dcc-8a98-8b7182810f51 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:50.013281 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-178f68fd-0b33-4dcc-8a98-8b7182810f51 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.218087 May 26 18:22:50.014073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 332/651] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:49 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:50.114259 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1020fcf8-039b-4a38-b572-0d48d12a133f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:50.114984 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1020fcf8-039b-4a38-b572-0d48d12a133f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:50.123987 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1020fcf8-039b-4a38-b572-0d48d12a133f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:50.124435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1020fcf8-039b-4a38-b572-0d48d12a133f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:50.125468 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1020fcf8-039b-4a38-b572-0d48d12a133f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:50.125824 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1020fcf8-039b-4a38-b572-0d48d12a133f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:50.324513 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1020fcf8-039b-4a38-b572-0d48d12a133f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:50.332830 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1020fcf8-039b-4a38-b572-0d48d12a133f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1362 microversion: 2.1 time: 0.223070 May 26 18:22:50.333408 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 320/652] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:50 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:50.376170 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-84a74126-c7ef-4d54-8c44-56e89cdca622 req-068a9c06-e304-4542-9dbd-2ac57ea92eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26af75eb-5db2-4a22-94ae-8b9f18a3dd90", "tag": "753009b3-34ab-4d28-8615-7b4ef5d0174c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:50.385575 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-84a74126-c7ef-4d54-8c44-56e89cdca622 req-068a9c06-e304-4542-9dbd-2ac57ea92eb8 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:50.386052 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-84a74126-c7ef-4d54-8c44-56e89cdca622 req-068a9c06-e304-4542-9dbd-2ac57ea92eb8 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:50.402956 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-84a74126-c7ef-4d54-8c44-56e89cdca622 req-068a9c06-e304-4542-9dbd-2ac57ea92eb8 service nova] Creating event network-changed:753009b3-34ab-4d28-8615-7b4ef5d0174c for instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 on hv-cinder-84349 May 26 18:22:50.407851 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-84a74126-c7ef-4d54-8c44-56e89cdca622 req-068a9c06-e304-4542-9dbd-2ac57ea92eb8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036036 May 26 18:22:50.408393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 333/653] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:50.695785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0a60dd9e-bfb2-431c-82ce-5601dcaeeb5d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:50.696572 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0a60dd9e-bfb2-431c-82ce-5601dcaeeb5d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:50.703500 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a60dd9e-bfb2-431c-82ce-5601dcaeeb5d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:50.703957 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a60dd9e-bfb2-431c-82ce-5601dcaeeb5d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:50.704734 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a60dd9e-bfb2-431c-82ce-5601dcaeeb5d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:50.705177 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a60dd9e-bfb2-431c-82ce-5601dcaeeb5d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:50.706270 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d1d75d74-2dec-4f7b-96ab-58b2bf999bf2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:50.707001 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d1d75d74-2dec-4f7b-96ab-58b2bf999bf2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:50.713477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1d75d74-2dec-4f7b-96ab-58b2bf999bf2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:50.713973 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1d75d74-2dec-4f7b-96ab-58b2bf999bf2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:50.714745 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1d75d74-2dec-4f7b-96ab-58b2bf999bf2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:50.715183 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d1d75d74-2dec-4f7b-96ab-58b2bf999bf2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:50.723059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:50.901014 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0a60dd9e-bfb2-431c-82ce-5601dcaeeb5d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:50.904472 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d1d75d74-2dec-4f7b-96ab-58b2bf999bf2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:50.908584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0a60dd9e-bfb2-431c-82ce-5601dcaeeb5d tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.269182 May 26 18:22:50.909163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 321/654] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:50 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:50.916358 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d1d75d74-2dec-4f7b-96ab-58b2bf999bf2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1554 microversion: 2.1 time: 0.214164 May 26 18:22:50.916846 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 334/655] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:50 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:51.031077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d32eedd0-7a4d-40da-bf12-47ed23b17849 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:51.031699 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d32eedd0-7a4d-40da-bf12-47ed23b17849 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:51.037945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d32eedd0-7a4d-40da-bf12-47ed23b17849 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.038702 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d32eedd0-7a4d-40da-bf12-47ed23b17849 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.039818 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d32eedd0-7a4d-40da-bf12-47ed23b17849 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.041141 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d32eedd0-7a4d-40da-bf12-47ed23b17849 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.251780 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d32eedd0-7a4d-40da-bf12-47ed23b17849 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:51.259977 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d32eedd0-7a4d-40da-bf12-47ed23b17849 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.233384 May 26 18:22:51.260546 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 322/656] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:51 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:51.350355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7216e876-568d-4cb2-b9a3-fae32089ecb8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:51.350975 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7216e876-568d-4cb2-b9a3-fae32089ecb8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:51.357811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7216e876-568d-4cb2-b9a3-fae32089ecb8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.358267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7216e876-568d-4cb2-b9a3-fae32089ecb8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.359030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7216e876-568d-4cb2-b9a3-fae32089ecb8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.359467 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7216e876-568d-4cb2-b9a3-fae32089ecb8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.496717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7216e876-568d-4cb2-b9a3-fae32089ecb8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:51.506603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7216e876-568d-4cb2-b9a3-fae32089ecb8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1548 microversion: 2.1 time: 0.159625 May 26 18:22:51.507622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 335/657] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:51 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:51.525522 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-43df23f4-0d59-4a6d-9332-05cf890a992d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:51.526102 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-43df23f4-0d59-4a6d-9332-05cf890a992d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:51.532082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-43df23f4-0d59-4a6d-9332-05cf890a992d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.532524 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-43df23f4-0d59-4a6d-9332-05cf890a992d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.533278 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-43df23f4-0d59-4a6d-9332-05cf890a992d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.533706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-43df23f4-0d59-4a6d-9332-05cf890a992d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.615619 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-43df23f4-0d59-4a6d-9332-05cf890a992d tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095725 May 26 18:22:51.616253 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 323/658] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 18:22:51 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:51.926684 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-23953377-9725-4f05-b19c-cc3c81945a79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:51.927307 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-23953377-9725-4f05-b19c-cc3c81945a79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:51.934356 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1192ff41-5288-4fd5-bd33-e3e5a2a94d18 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:51.934746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23953377-9725-4f05-b19c-cc3c81945a79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.935205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23953377-9725-4f05-b19c-cc3c81945a79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.935319 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1192ff41-5288-4fd5-bd33-e3e5a2a94d18 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:51.935987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23953377-9725-4f05-b19c-cc3c81945a79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.936426 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-23953377-9725-4f05-b19c-cc3c81945a79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.942191 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1192ff41-5288-4fd5-bd33-e3e5a2a94d18 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.942649 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1192ff41-5288-4fd5-bd33-e3e5a2a94d18 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:51.943435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1192ff41-5288-4fd5-bd33-e3e5a2a94d18 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:51.943873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1192ff41-5288-4fd5-bd33-e3e5a2a94d18 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:52.421942 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-23953377-9725-4f05-b19c-cc3c81945a79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:52.429709 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-23953377-9725-4f05-b19c-cc3c81945a79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.507259 May 26 18:22:52.430312 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 336/659] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:51 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:52.435678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2d96d3b2-3305-4418-b1ee-212fd3843b41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:52.436294 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2d96d3b2-3305-4418-b1ee-212fd3843b41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:52.442686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d96d3b2-3305-4418-b1ee-212fd3843b41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:52.443144 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d96d3b2-3305-4418-b1ee-212fd3843b41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:52.443916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d96d3b2-3305-4418-b1ee-212fd3843b41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:52.444359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2d96d3b2-3305-4418-b1ee-212fd3843b41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:52.450440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1192ff41-5288-4fd5-bd33-e3e5a2a94d18 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:52.458531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1192ff41-5288-4fd5-bd33-e3e5a2a94d18 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1554 microversion: 2.1 time: 0.528689 May 26 18:22:52.459385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 324/660] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:51 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1554 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:52.703428 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2d96d3b2-3305-4418-b1ee-212fd3843b41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:52.711082 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2d96d3b2-3305-4418-b1ee-212fd3843b41 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.278989 May 26 18:22:52.711587 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 337/661] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:52 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:53.003154 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-92870d68-0f9e-4428-a99a-9057247cf5b9 req-58e1345d-e62b-4914-bcde-9dcf4fdfd9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34599fe-7096-4f0a-a115-f975c3cbee2c", "tag": "17b9f864-286f-441e-acbd-070ab315d197"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:53.012423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-92870d68-0f9e-4428-a99a-9057247cf5b9 req-58e1345d-e62b-4914-bcde-9dcf4fdfd9e6 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:53.012861 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-92870d68-0f9e-4428-a99a-9057247cf5b9 req-58e1345d-e62b-4914-bcde-9dcf4fdfd9e6 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:53.023797 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-92870d68-0f9e-4428-a99a-9057247cf5b9 req-58e1345d-e62b-4914-bcde-9dcf4fdfd9e6 service nova] Creating event network-changed:17b9f864-286f-441e-acbd-070ab315d197 for instance d34599fe-7096-4f0a-a115-f975c3cbee2c on hv-cinder-84349 May 26 18:22:53.028922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-92870d68-0f9e-4428-a99a-9057247cf5b9 req-58e1345d-e62b-4914-bcde-9dcf4fdfd9e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029535 May 26 18:22:53.029594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 325/662] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:53.447215 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-569c1ef0-8de6-497a-a34f-30fdb0932480 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:53.447836 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-569c1ef0-8de6-497a-a34f-30fdb0932480 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:53.454615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-569c1ef0-8de6-497a-a34f-30fdb0932480 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:53.455072 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-569c1ef0-8de6-497a-a34f-30fdb0932480 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:53.455846 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-569c1ef0-8de6-497a-a34f-30fdb0932480 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:53.456289 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-569c1ef0-8de6-497a-a34f-30fdb0932480 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:53.483578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-62057641-085a-404b-800e-0c01ead0335b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:53.484277 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-62057641-085a-404b-800e-0c01ead0335b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:53.490592 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62057641-085a-404b-800e-0c01ead0335b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:53.491046 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62057641-085a-404b-800e-0c01ead0335b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:53.491808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62057641-085a-404b-800e-0c01ead0335b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:53.492240 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-62057641-085a-404b-800e-0c01ead0335b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:53.670603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-569c1ef0-8de6-497a-a34f-30fdb0932480 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:53.679475 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-569c1ef0-8de6-497a-a34f-30fdb0932480 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.236323 May 26 18:22:53.680454 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 338/663] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:53 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:53.689938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-62057641-085a-404b-800e-0c01ead0335b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:53.696351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-62057641-085a-404b-800e-0c01ead0335b tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1554 microversion: 2.1 time: 0.217742 May 26 18:22:53.697310 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 326/664] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:53 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:53.728275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2bcc6476-5dea-4560-a25c-3d0673239c38 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:53.729224 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2bcc6476-5dea-4560-a25c-3d0673239c38 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:53.735311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2bcc6476-5dea-4560-a25c-3d0673239c38 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:53.735763 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2bcc6476-5dea-4560-a25c-3d0673239c38 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:53.736534 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2bcc6476-5dea-4560-a25c-3d0673239c38 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:53.736966 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2bcc6476-5dea-4560-a25c-3d0673239c38 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:53.878993 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2bcc6476-5dea-4560-a25c-3d0673239c38 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:53.887686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2bcc6476-5dea-4560-a25c-3d0673239c38 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1523 microversion: 2.1 time: 0.163836 May 26 18:22:53.888277 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 339/665] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:53 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:54.697848 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-863da557-460f-446a-85da-8e6b2ced8f1c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:54.699052 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-863da557-460f-446a-85da-8e6b2ced8f1c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:54.706034 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-863da557-460f-446a-85da-8e6b2ced8f1c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:54.706688 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-863da557-460f-446a-85da-8e6b2ced8f1c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:54.707815 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-863da557-460f-446a-85da-8e6b2ced8f1c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:54.708250 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-863da557-460f-446a-85da-8e6b2ced8f1c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:54.713916 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fc204d74-244c-4faf-a4ae-19a77795f20a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:54.714941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fc204d74-244c-4faf-a4ae-19a77795f20a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:54.725429 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc204d74-244c-4faf-a4ae-19a77795f20a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:54.726195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc204d74-244c-4faf-a4ae-19a77795f20a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:54.727126 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc204d74-244c-4faf-a4ae-19a77795f20a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:54.729077 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc204d74-244c-4faf-a4ae-19a77795f20a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:55.207621 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fc204d74-244c-4faf-a4ae-19a77795f20a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:55.215893 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fc204d74-244c-4faf-a4ae-19a77795f20a tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1554 microversion: 2.1 time: 0.506361 May 26 18:22:55.216542 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 340/666] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:54 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1554 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:55.230947 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:55.231568 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:55.238035 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:55.238409 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:55.239496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:55.239617 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:55.283705 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:55.284298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:55.284805 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lazy-loading 'fault' on Instance uuid e56b5f3b-8d96-4c3a-92d3-8abd6feea703 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:55.506580 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-863da557-460f-446a-85da-8e6b2ced8f1c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:55.514055 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-863da557-460f-446a-85da-8e6b2ced8f1c tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.820910 May 26 18:22:55.514634 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 327/667] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:54 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:55.519013 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-ceb2b367-c6bf-454e-80f0-d2cc5870183e req-9822f642-7f47-48ef-97cb-dcb08eb7ce73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56b5f3b-8d96-4c3a-92d3-8abd6feea703", "name": "network-vif-deleted", "tag": "afd70552-5afd-45e8-8ac9-e7f6449dc43e"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:55.527864 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ceb2b367-c6bf-454e-80f0-d2cc5870183e req-9822f642-7f47-48ef-97cb-dcb08eb7ce73 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:55.528300 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ceb2b367-c6bf-454e-80f0-d2cc5870183e req-9822f642-7f47-48ef-97cb-dcb08eb7ce73 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:55.539699 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-ceb2b367-c6bf-454e-80f0-d2cc5870183e req-9822f642-7f47-48ef-97cb-dcb08eb7ce73 service nova] Creating event network-vif-deleted:afd70552-5afd-45e8-8ac9-e7f6449dc43e for instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 on hv-cinder-84349 May 26 18:22:55.545308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-ceb2b367-c6bf-454e-80f0-d2cc5870183e req-9822f642-7f47-48ef-97cb-dcb08eb7ce73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029544 May 26 18:22:55.549808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 328/668] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:55.588379 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3f8de4a3b54d58806506b827cfa89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb09766b9784d50aad144d466a5d050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:55.597918 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3401a688-b465-48b3-9f70-c116e7ca3ae7 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 200 len: 1312 microversion: 2.1 time: 0.371487 May 26 18:22:55.599096 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 341/669] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:55 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 1312 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:55.683008 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=4 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:55.683917 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=16 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:55.689267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-f636c4cc-145d-48c0-b542-3bde5d61430e req-75d52378-f68e-4ef0-aab7-de943fdeaacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37c198f-b170-4773-8436-c52a8d5b934b", "name": "network-vif-unplugged", "status": "completed", "tag": "c471eca6-7897-4bd4-980d-b46e7fcc2133"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:55.699531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-f636c4cc-145d-48c0-b542-3bde5d61430e req-75d52378-f68e-4ef0-aab7-de943fdeaacc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:55.701120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-f636c4cc-145d-48c0-b542-3bde5d61430e req-75d52378-f68e-4ef0-aab7-de943fdeaacc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:55.712753 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-f636c4cc-145d-48c0-b542-3bde5d61430e req-75d52378-f68e-4ef0-aab7-de943fdeaacc service nova] Creating event network-vif-unplugged:c471eca6-7897-4bd4-980d-b46e7fcc2133 for instance b37c198f-b170-4773-8436-c52a8d5b934b on hv-cinder-84349 May 26 18:22:55.717589 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-f636c4cc-145d-48c0-b542-3bde5d61430e req-75d52378-f68e-4ef0-aab7-de943fdeaacc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036582 May 26 18:22:55.718294 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 329/670] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:22:56.046252 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-9448f2af-ba98-4c64-9bf2-2ed6fbeb19bf req-2b35947c-35d5-4970-9315-a82c660854e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37c198f-b170-4773-8436-c52a8d5b934b", "name": "network-vif-deleted", "tag": "c471eca6-7897-4bd4-980d-b46e7fcc2133"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:56.050825 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=8 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:56.056735 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9448f2af-ba98-4c64-9bf2-2ed6fbeb19bf req-2b35947c-35d5-4970-9315-a82c660854e9 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:56.057341 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-9448f2af-ba98-4c64-9bf2-2ed6fbeb19bf req-2b35947c-35d5-4970-9315-a82c660854e9 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:56.069275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-9448f2af-ba98-4c64-9bf2-2ed6fbeb19bf req-2b35947c-35d5-4970-9315-a82c660854e9 service nova] Creating event network-vif-deleted:c471eca6-7897-4bd4-980d-b46e7fcc2133 for instance b37c198f-b170-4773-8436-c52a8d5b934b on hv-cinder-84349 May 26 18:22:56.074820 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-9448f2af-ba98-4c64-9bf2-2ed6fbeb19bf req-2b35947c-35d5-4970-9315-a82c660854e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032528 May 26 18:22:56.075439 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 342/671] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:56.233052 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:56.233887 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:56.239923 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:56.240614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:56.241386 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:56.241841 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:56.275474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:56.276163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:56.276824 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lazy-loading 'fault' on Instance uuid b37c198f-b170-4773-8436-c52a8d5b934b {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:56.324452 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5462b6a8d72749b9a07cd52ff8cb29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08521617c884fe9a67609887f0ddaae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:56.332452 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f1c02e59-9196-474b-a033-fd07a73641fe tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 200 len: 1348 microversion: 2.1 time: 0.103537 May 26 18:22:56.333108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 330/672] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:56 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:56.532909 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bdba1070-1023-4c5f-94d9-95af7f5668c7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:56.533517 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bdba1070-1023-4c5f-94d9-95af7f5668c7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:56.539772 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bdba1070-1023-4c5f-94d9-95af7f5668c7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:56.540788 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bdba1070-1023-4c5f-94d9-95af7f5668c7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:56.541555 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bdba1070-1023-4c5f-94d9-95af7f5668c7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:56.542022 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bdba1070-1023-4c5f-94d9-95af7f5668c7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:56.616452 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:56.617065 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] [instance: e56b5f3b-8d96-4c3a-92d3-8abd6feea703] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:56.623256 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:56.623712 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:56.624482 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:56.624922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:56.638367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] HTTP exception thrown: Instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 could not be found. May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Request method failure captured: May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 HTTP/1.1 May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RWODLYi3wdaspll1zSy4mFYh46s3GN57iRM-L_-oq2PC7kcMeh3vdvzheNADnGzneVMfEKJQD3fIE7UbLMCCJH1QIAx7okekyzdCgqUMi23a9gOm7NEbdM2gUEcXOy9FAQIbx6XMUkM4IF8RynHZWEW4I9HmMmXTcFriT68BGeYPA May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:22:56.640010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5cb09766b9784d50aad144d466a5d050"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5cb09766b9784d50aad144d466a5d050", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 5cb09766b9784d50aad144d466a5d050 May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-364244745 May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 3b3f8de4a3b54d58806506b827cfa89a May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-364244745-project May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 could not be found. May 26 18:22:56.641531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'e56b5f3b-8d96-4c3a-92d3-8abd6feea703'} May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 could not be found. May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:56.642481 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 could not be found. May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 could not be found. May 26 18:22:56.643965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:56.645414 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] Returning 404 to user: Instance e56b5f3b-8d96-4c3a-92d3-8abd6feea703 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:56.645414 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-494d9de1-21c9-4194-865f-1f8c18418c18 tempest-ServerRescueNegativeTestJSON-364244745 tempest-ServerRescueNegativeTestJSON-364244745-project] 10.222.0.46 "GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703" status: 404 len: 111 microversion: 2.1 time: 0.029021 May 26 18:22:56.645414 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 331/673] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:56 2022] GET /compute/v2.1/servers/e56b5f3b-8d96-4c3a-92d3-8abd6feea703 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:22:56.675757 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bdba1070-1023-4c5f-94d9-95af7f5668c7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:56.683872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bdba1070-1023-4c5f-94d9-95af7f5668c7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.156229 May 26 18:22:56.684445 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 343/674] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:56 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:57.350377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:57.350990 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] [instance: b37c198f-b170-4773-8436-c52a8d5b934b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:57.357860 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:57.358345 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:57.359115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:57.359548 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:57.373421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] HTTP exception thrown: Instance b37c198f-b170-4773-8436-c52a8d5b934b could not be found. May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Request method failure captured: May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b HTTP/1.1 May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8TAkWL0PdfXyAihYysUx1d7xyeI2IaKvI7C5XEhMozWjX4mK-wgCRpHDGOt_1VI7BFpnPcSAgu-OfmpCiax8yDIDjrqplpg2iNfO5kGZfPEIp6KpWboaxLOBC2A2bEIb5wBNbz1SypjpxHWtK2eTWPWvgpQ1P-G8dKiX4QZ_wiEGs8 May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: d08521617c884fe9a67609887f0ddaae May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-TestMinimumBasicScenario-1676833738 May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:22:57.374955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d08521617c884fe9a67609887f0ddaae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d08521617c884fe9a67609887f0ddaae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d08521617c884fe9a67609887f0ddaae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d08521617c884fe9a67609887f0ddaae", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-TestMinimumBasicScenario-1676833738 May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: d08521617c884fe9a67609887f0ddaae May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1676833738 May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-TestMinimumBasicScenario-1676833738-project May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 5462b6a8d72749b9a07cd52ff8cb29d1 May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-TestMinimumBasicScenario-1676833738-project May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance b37c198f-b170-4773-8436-c52a8d5b934b could not be found. May 26 18:22:57.376466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'b37c198f-b170-4773-8436-c52a8d5b934b'} May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b37c198f-b170-4773-8436-c52a8d5b934b could not be found. May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:57.377431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b37c198f-b170-4773-8436-c52a8d5b934b could not be found. May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b37c198f-b170-4773-8436-c52a8d5b934b could not be found. May 26 18:22:57.378938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:22:57.380800 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Returning 404 to user: Instance b37c198f-b170-4773-8436-c52a8d5b934b could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:57.380800 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-386e5ab9-9afc-4ccf-bb76-e746a83581c2 tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b" status: 404 len: 111 microversion: 2.1 time: 0.029863 May 26 18:22:57.380800 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 332/675] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:57 2022] GET /compute/v2.1/servers/b37c198f-b170-4773-8436-c52a8d5b934b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:22:57.386339 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5911c234-04f7-4a72-ab96-fa152acf986e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] Calling method '.version_select at 0x7f5f1836e4c0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:57.403683 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5911c234-04f7-4a72-ab96-fa152acf986e tempest-TestMinimumBasicScenario-1676833738 tempest-TestMinimumBasicScenario-1676833738-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-714646482" status: 202 len: 0 microversion: 2.1 time: 0.022404 May 26 18:22:57.404253 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 344/676] 10.222.0.46 () {58 vars in 1268 bytes} [Thu May 26 18:22:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-714646482 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:22:57.700945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-552cf35e-e437-438f-9b01-3a2eab948e04 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:57.701944 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-552cf35e-e437-438f-9b01-3a2eab948e04 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:57.717325 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-552cf35e-e437-438f-9b01-3a2eab948e04 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:57.717924 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-552cf35e-e437-438f-9b01-3a2eab948e04 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:57.719011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-552cf35e-e437-438f-9b01-3a2eab948e04 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:57.719661 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-552cf35e-e437-438f-9b01-3a2eab948e04 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:57.895956 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-552cf35e-e437-438f-9b01-3a2eab948e04 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:57.905774 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-552cf35e-e437-438f-9b01-3a2eab948e04 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.208905 May 26 18:22:57.916543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 333/677] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:57 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:58.926578 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4bdd2406-6107-4bbf-b4db-6810bab93d21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:58.927201 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4bdd2406-6107-4bbf-b4db-6810bab93d21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:58.934786 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4bdd2406-6107-4bbf-b4db-6810bab93d21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:58.935249 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4bdd2406-6107-4bbf-b4db-6810bab93d21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:58.936047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4bdd2406-6107-4bbf-b4db-6810bab93d21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:58.936492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4bdd2406-6107-4bbf-b4db-6810bab93d21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:59.163326 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4bdd2406-6107-4bbf-b4db-6810bab93d21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:59.172739 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4bdd2406-6107-4bbf-b4db-6810bab93d21 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.252661 May 26 18:22:59.174020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 345/678] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:22:58 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:23:00.190596 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-032e31d9-5b09-421f-9d5b-c30be031aba7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:00.191845 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-032e31d9-5b09-421f-9d5b-c30be031aba7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:00.209397 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-032e31d9-5b09-421f-9d5b-c30be031aba7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:00.209678 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-032e31d9-5b09-421f-9d5b-c30be031aba7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:00.210603 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-032e31d9-5b09-421f-9d5b-c30be031aba7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:00.211045 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-032e31d9-5b09-421f-9d5b-c30be031aba7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:00.544245 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-032e31d9-5b09-421f-9d5b-c30be031aba7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:00.565218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-032e31d9-5b09-421f-9d5b-c30be031aba7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.378560 May 26 18:23:00.565850 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 334/679] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:23:00 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:23:01.582871 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-be323684-822e-4274-abc1-1dc0e1931de7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:01.584220 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-be323684-822e-4274-abc1-1dc0e1931de7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:01.591933 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be323684-822e-4274-abc1-1dc0e1931de7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:01.592574 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be323684-822e-4274-abc1-1dc0e1931de7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:01.593505 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be323684-822e-4274-abc1-1dc0e1931de7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:01.594133 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-be323684-822e-4274-abc1-1dc0e1931de7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:01.865171 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-be323684-822e-4274-abc1-1dc0e1931de7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:01.875369 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-be323684-822e-4274-abc1-1dc0e1931de7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.296213 May 26 18:23:01.876281 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 346/680] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:23:01 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:23:01.902095 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-f086490f-64cd-43ba-9106-621cb0dbd124 req-6893f7d7-4204-461f-a7ce-accbc327d306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26af75eb-5db2-4a22-94ae-8b9f18a3dd90", "name": "network-vif-plugged", "status": "completed", "tag": "753009b3-34ab-4d28-8615-7b4ef5d0174c"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:01.921256 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-f086490f-64cd-43ba-9106-621cb0dbd124 req-6893f7d7-4204-461f-a7ce-accbc327d306 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:01.922070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-f086490f-64cd-43ba-9106-621cb0dbd124 req-6893f7d7-4204-461f-a7ce-accbc327d306 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:01.954130 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-f086490f-64cd-43ba-9106-621cb0dbd124 req-6893f7d7-4204-461f-a7ce-accbc327d306 service nova] Creating event network-vif-plugged:753009b3-34ab-4d28-8615-7b4ef5d0174c for instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 on hv-cinder-84349 May 26 18:23:01.963458 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-f086490f-64cd-43ba-9106-621cb0dbd124 req-6893f7d7-4204-461f-a7ce-accbc327d306 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070333 May 26 18:23:01.965944 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 335/681] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:02.248910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-12bf804b-f756-4b49-bd9c-e9e64745d624 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Action: 'create', calling method: .version_select at 0x7f5f1836e550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-122598646"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:02.571620 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-12bf804b-f756-4b49-bd9c-e9e64745d624 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.520928 May 26 18:23:02.572852 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 347/682] 10.222.0.46 () {60 vars in 1154 bytes} [Thu May 26 18:23:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 523 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 18:23:02.584141 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-da1eec85-c0a7-442d-9f6d-dfd6c557a435 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18d81a60>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:02.641077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-da1eec85-c0a7-442d-9f6d-dfd6c557a435 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1" status: 200 len: 344 microversion: 2.1 time: 0.061077 May 26 18:23:02.641755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 336/683] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:23:02 2022] GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:02.894601 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1a36e8de-e9b1-4555-ae55-affd7bba95bf tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:02.895226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1a36e8de-e9b1-4555-ae55-affd7bba95bf tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:02.902319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a36e8de-e9b1-4555-ae55-affd7bba95bf tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:02.902774 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a36e8de-e9b1-4555-ae55-affd7bba95bf tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:02.903524 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a36e8de-e9b1-4555-ae55-affd7bba95bf tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:02.903963 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1a36e8de-e9b1-4555-ae55-affd7bba95bf tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:03.038620 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1a36e8de-e9b1-4555-ae55-affd7bba95bf tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:03.046849 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1a36e8de-e9b1-4555-ae55-affd7bba95bf tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1366 microversion: 2.1 time: 0.157027 May 26 18:23:03.047563 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 348/684] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:23:02 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:23:03.654360 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0a2121f8-8cb8-4843-8c7f-34df68d4e95d tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18d2edc0>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:03.712718 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0a2121f8-8cb8-4843-8c7f-34df68d4e95d tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1" status: 200 len: 345 microversion: 2.1 time: 0.061315 May 26 18:23:03.713445 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 337/685] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:23:03 2022] GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:03.724786 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-41401e0a-ac1f-4734-9f75-6d8cfc13d16c tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Action: 'create', calling method: .version_select at 0x7f5f1836e4c0>, body: {"snapshot": {"volume_id": "c8fd352d-8c84-43d7-8886-527f3a4338c1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1724496254"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:03.903171 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-41401e0a-ac1f-4734-9f75-6d8cfc13d16c tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.182391 May 26 18:23:03.910857 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 349/686] 10.222.0.46 () {60 vars in 1161 bytes} [Thu May 26 18:23:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:23:03.914008 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-789c0f04-43ec-43e6-9dea-9441ad3887a6 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18e56f70>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:03.951025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-789c0f04-43ec-43e6-9dea-9441ad3887a6 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834" status: 200 len: 287 microversion: 2.1 time: 0.040992 May 26 18:23:03.951720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 338/687] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 18:23:03 2022] GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:03.966906 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-aa3b1fce-02cf-4be1-a5b4-b6289ee945ee tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f183f29d0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:04.014981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-aa3b1fce-02cf-4be1-a5b4-b6289ee945ee tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.054689 May 26 18:23:04.021663 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 350/688] 10.222.0.46 () {58 vars in 1139 bytes} [Thu May 26 18:23:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:04.030167 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-965c5dc7-386d-418c-8020-b71b82d9dc92 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18bef160>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:04.067527 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-51c3ac5d-db40-4908-b15a-bf66d7144b6a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:04.068944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-51c3ac5d-db40-4908-b15a-bf66d7144b6a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:04.081603 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-965c5dc7-386d-418c-8020-b71b82d9dc92 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834" status: 200 len: 287 microversion: 2.1 time: 0.057108 May 26 18:23:04.082050 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51c3ac5d-db40-4908-b15a-bf66d7144b6a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:04.082718 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51c3ac5d-db40-4908-b15a-bf66d7144b6a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:04.083965 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51c3ac5d-db40-4908-b15a-bf66d7144b6a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:04.085247 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51c3ac5d-db40-4908-b15a-bf66d7144b6a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:04.089278 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 339/689] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 18:23:04 2022] GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:04.274519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-51c3ac5d-db40-4908-b15a-bf66d7144b6a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:04.283475 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-51c3ac5d-db40-4908-b15a-bf66d7144b6a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1556 microversion: 2.1 time: 0.220869 May 26 18:23:04.284314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 351/690] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:23:04 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1556 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:23:04.301826 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-765ad3bc-287e-4762-b616-902d5e441064 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:04.302638 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-765ad3bc-287e-4762-b616-902d5e441064 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:04.310398 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-765ad3bc-287e-4762-b616-902d5e441064 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:04.310994 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-765ad3bc-287e-4762-b616-902d5e441064 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:04.311888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-765ad3bc-287e-4762-b616-902d5e441064 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:04.312474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-765ad3bc-287e-4762-b616-902d5e441064 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:04.402927 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-765ad3bc-287e-4762-b616-902d5e441064 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105365 May 26 18:23:04.403528 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 340/691] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 18:23:04 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:05.097392 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-37a6b09d-942b-47e2-b944-1fcf16ae3ead tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f183b90d0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:05.151110 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-37a6b09d-942b-47e2-b944-1fcf16ae3ead tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834" status: 200 len: 287 microversion: 2.1 time: 0.058135 May 26 18:23:05.151945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 352/692] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 18:23:05 2022] GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:23:05.445502 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-5d4a563f-98a1-43c6-a4d2-376932b67760 req-4d50330e-024f-43f4-a0f1-fead3bce8a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26af75eb-5db2-4a22-94ae-8b9f18a3dd90", "tag": "753009b3-34ab-4d28-8615-7b4ef5d0174c"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:05.456599 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-5d4a563f-98a1-43c6-a4d2-376932b67760 req-4d50330e-024f-43f4-a0f1-fead3bce8a6d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:05.457574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-5d4a563f-98a1-43c6-a4d2-376932b67760 req-4d50330e-024f-43f4-a0f1-fead3bce8a6d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:05.471859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-5d4a563f-98a1-43c6-a4d2-376932b67760 req-4d50330e-024f-43f4-a0f1-fead3bce8a6d service nova] Creating event network-changed:753009b3-34ab-4d28-8615-7b4ef5d0174c for instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 on hv-cinder-84349 May 26 18:23:05.477566 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-5d4a563f-98a1-43c6-a4d2-376932b67760 req-4d50330e-024f-43f4-a0f1-fead3bce8a6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036755 May 26 18:23:05.478215 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 341/693] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:06.163789 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e267a7ce-a8dc-468c-99bf-4042337b9584 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f1833e8b0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:06.197720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e267a7ce-a8dc-468c-99bf-4042337b9584 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834" status: 200 len: 287 microversion: 2.1 time: 0.038188 May 26 18:23:06.200304 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 353/694] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 18:23:06 2022] GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:07.213276 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-58c97972-8957-4c00-a84c-0a3cd0ce1642 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18d81700>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:07.242555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-58c97972-8957-4c00-a84c-0a3cd0ce1642 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834" status: 200 len: 288 microversion: 2.1 time: 0.035011 May 26 18:23:07.243436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 342/695] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 18:23:07 2022] GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:07.254199 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bc91e204-93ff-4a1f-9e27-f981c6b73197 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f183438b0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:07.475829 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bc91e204-93ff-4a1f-9e27-f981c6b73197 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834" status: 202 len: 0 microversion: 2.1 time: 0.225920 May 26 18:23:07.476409 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 354/696] 10.222.0.46 () {58 vars in 1253 bytes} [Thu May 26 18:23:07 2022] DELETE /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:23:07.484768 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-832df3b9-7179-4fbc-8c01-b1e012c016f0 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18ccfca0>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:07.516615 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-832df3b9-7179-4fbc-8c01-b1e012c016f0 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834" status: 200 len: 287 microversion: 2.1 time: 0.035693 May 26 18:23:07.517195 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 343/697] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 18:23:07 2022] GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:08.528381 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4c63f99e-cfeb-40f7-bb88-8203f4c9b044 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f1840fa60>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:08.553415 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-4c63f99e-cfeb-40f7-bb88-8203f4c9b044 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] HTTP exception thrown: Snapshot da08ef27-9cd9-4639-bc64-40785f9e3834 could not be found. May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4c63f99e-cfeb-40f7-bb88-8203f4c9b044 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Request method failure captured: May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 HTTP/1.1 May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8WFgUqEl1uta1yPHUPJ99HJLrAsYSB5DDhONMdOCGgUlGBRg4-npVL71us7hvJoXLTMuWRWZqTist_4lKfCQRTH86SryJfclj2QRvzPRUceNMXzY2GeTfwKwsXZiHH2aTUTnPdRV-ToZKUFmBhRSR2XQ85bSyOJDx5EmPYbrtoEgbk May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 4f49540028c649c6814a5662d387ab7c May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:23:08.562746 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f49540028c649c6814a5662d387ab7c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 4f49540028c649c6814a5662d387ab7c May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesSnapshotsTestJSON-1936060267-project May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: ae265b5e580545de9c9ae6514fc1f7c4 May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1936060267-project May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Snapshot da08ef27-9cd9-4639-bc64-40785f9e3834 could not be found. May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'da08ef27-9cd9-4639-bc64-40785f9e3834'} May 26 18:23:08.564322 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot da08ef27-9cd9-4639-bc64-40785f9e3834 could not be found. (HTTP 404) (Request-ID: req-ded92331-0780-4aca-b07a-69bef5ac6f3a) May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:08.565461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:23:08.566811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot da08ef27-9cd9-4639-bc64-40785f9e3834 could not be found. May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 18:23:08.568478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot da08ef27-9cd9-4639-bc64-40785f9e3834 could not be found. May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot da08ef27-9cd9-4639-bc64-40785f9e3834 could not be found. May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4c63f99e-cfeb-40f7-bb88-8203f4c9b044 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Returning 404 to user: Snapshot da08ef27-9cd9-4639-bc64-40785f9e3834 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:08.569929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4c63f99e-cfeb-40f7-bb88-8203f4c9b044 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834" status: 404 len: 111 microversion: 2.1 time: 0.040704 May 26 18:23:08.570961 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 355/698] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 18:23:08 2022] GET /compute/v2.1/os-snapshots/da08ef27-9cd9-4639-bc64-40785f9e3834 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:23:08.572816 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e800b4be-f857-40d9-b40a-59f1d5209fd4 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18bef040>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:08.633102 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e800b4be-f857-40d9-b40a-59f1d5209fd4 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1" status: 202 len: 0 microversion: 2.1 time: 0.064008 May 26 18:23:08.634037 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 344/699] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:23:08 2022] DELETE /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:23:08.642721 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1b761234-61db-4dc2-8faa-e1ac3ff97c5f tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f1a25c9d0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:08.690201 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1b761234-61db-4dc2-8faa-e1ac3ff97c5f tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1" status: 200 len: 344 microversion: 2.1 time: 0.051649 May 26 18:23:08.690773 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 356/700] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:23:08 2022] GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:09.703742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bf7750a1-365b-49e9-9f39-7f15fffbe97a tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18ccf700>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:09.731367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-bf7750a1-365b-49e9-9f39-7f15fffbe97a tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] HTTP exception thrown: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bf7750a1-365b-49e9-9f39-7f15fffbe97a tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Request method failure captured: May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 HTTP/1.1 May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8WFgUqEl1uta1yPHUPJ99HJLrAsYSB5DDhONMdOCGgUlGBRg4-npVL71us7hvJoXLTMuWRWZqTist_4lKfCQRTH86SryJfclj2QRvzPRUceNMXzY2GeTfwKwsXZiHH2aTUTnPdRV-ToZKUFmBhRSR2XQ85bSyOJDx5EmPYbrtoEgbk May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 4f49540028c649c6814a5662d387ab7c May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:23:09.734814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f49540028c649c6814a5662d387ab7c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 4f49540028c649c6814a5662d387ab7c May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-VolumesSnapshotsTestJSON-1936060267-project May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: ae265b5e580545de9c9ae6514fc1f7c4 May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1936060267-project May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'c8fd352d-8c84-43d7-8886-527f3a4338c1'} May 26 18:23:09.736349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. (HTTP 404) (Request-ID: req-fc34a05a-0dc2-4035-b2d9-9e8dea76c118) May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.737446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:23:09.738843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:23:09.740197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bf7750a1-365b-49e9-9f39-7f15fffbe97a tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Returning 404 to user: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-bf7750a1-365b-49e9-9f39-7f15fffbe97a tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1" status: 404 len: 109 microversion: 2.1 time: 0.036865 May 26 18:23:09.741742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 345/701] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:23:09 2022] GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:23:09.747997 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4dd69e71-4580-4d90-ab3c-7373bba21e15 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f183b9e50>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:09.776190 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-4dd69e71-4580-4d90-ab3c-7373bba21e15 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] HTTP exception thrown: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4dd69e71-4580-4d90-ab3c-7373bba21e15 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Request method failure captured: May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 HTTP/1.1 May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8WFgUqEl1uta1yPHUPJ99HJLrAsYSB5DDhONMdOCGgUlGBRg4-npVL71us7hvJoXLTMuWRWZqTist_4lKfCQRTH86SryJfclj2QRvzPRUceNMXzY2GeTfwKwsXZiHH2aTUTnPdRV-ToZKUFmBhRSR2XQ85bSyOJDx5EmPYbrtoEgbk May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 4f49540028c649c6814a5662d387ab7c May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:23:09.778449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f49540028c649c6814a5662d387ab7c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 4f49540028c649c6814a5662d387ab7c May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesSnapshotsTestJSON-1936060267-project May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: ae265b5e580545de9c9ae6514fc1f7c4 May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1936060267-project May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'c8fd352d-8c84-43d7-8886-527f3a4338c1'} May 26 18:23:09.780009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. (HTTP 404) (Request-ID: req-91dd030f-82f1-48cb-a253-3dd3621a6045) May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.780970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:23:09.782373 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:23:09.783769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4dd69e71-4580-4d90-ab3c-7373bba21e15 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Returning 404 to user: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4dd69e71-4580-4d90-ab3c-7373bba21e15 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1" status: 404 len: 109 microversion: 2.1 time: 0.037013 May 26 18:23:09.785154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 357/702] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:23:09 2022] DELETE /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:23:09.788205 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-32c527d5-e5ed-41c4-b100-fb16d3a658a0 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Calling method '.version_select at 0x7f5f18c17ee0>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:09.816681 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-32c527d5-e5ed-41c4-b100-fb16d3a658a0 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] HTTP exception thrown: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-32c527d5-e5ed-41c4-b100-fb16d3a658a0 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Request method failure captured: May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 HTTP/1.1 May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8WFgUqEl1uta1yPHUPJ99HJLrAsYSB5DDhONMdOCGgUlGBRg4-npVL71us7hvJoXLTMuWRWZqTist_4lKfCQRTH86SryJfclj2QRvzPRUceNMXzY2GeTfwKwsXZiHH2aTUTnPdRV-ToZKUFmBhRSR2XQ85bSyOJDx5EmPYbrtoEgbk May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 4f49540028c649c6814a5662d387ab7c May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:23:09.818662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f49540028c649c6814a5662d387ab7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f49540028c649c6814a5662d387ab7c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 4f49540028c649c6814a5662d387ab7c May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1936060267 May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-VolumesSnapshotsTestJSON-1936060267-project May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: ae265b5e580545de9c9ae6514fc1f7c4 May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1936060267-project May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'c8fd352d-8c84-43d7-8886-527f3a4338c1'} May 26 18:23:09.820082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. (HTTP 404) (Request-ID: req-a04df60e-1da1-4faa-b52e-894f8a77644c) May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.821486 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:23:09.823059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:23:09.824369 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-32c527d5-e5ed-41c4-b100-fb16d3a658a0 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] Returning 404 to user: Volume c8fd352d-8c84-43d7-8886-527f3a4338c1 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-32c527d5-e5ed-41c4-b100-fb16d3a658a0 tempest-VolumesSnapshotsTestJSON-1936060267 tempest-VolumesSnapshotsTestJSON-1936060267-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1" status: 404 len: 109 microversion: 2.1 time: 0.035585 May 26 18:23:09.825675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 346/703] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:23:09 2022] GET /compute/v2.1/os-volumes/c8fd352d-8c84-43d7-8886-527f3a4338c1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:23:11.192006 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b6ea9809-55f5-485e-a1d0-13007e44ad89 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Action: 'create', calling method: .version_select at 0x7f5f183f2940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-160009819", "metadata": {"Type": "work"}}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b6ea9809-55f5-485e-a1d0-13007e44ad89 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Request method failure captured: May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 121 May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8WOGoVgXq3_puFw-sUnSTH7IPyDvctE0TXKcR-QBCLataIrQWWQWHPYFmWrdBOCiu_GsHsifMdj2TNBLI_iZQNvkSs1FCdIh5KDJS6Lq-1Ch2HN4fVYYZ6aLz5Y7zpnv7oLg6pXIXjWL0odw04fMTM_HqB7_1sAKxdN7p4wIltCD04 May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:23:11.205172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_97f9489fba044b7ab4a27b197b017b06", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 87efe160534a48cdb253dd24245213e4 May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-160009819", "metadata": {"Type": "work"}}} May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: May 26 18:23:11.206743 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-160009819', 'metadata': {'Type': 'work'}}}} May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise error May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi '#$%' May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:11.207914 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:23:11.209438 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:23:11.210729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:23:11.210729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.210729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b6ea9809-55f5-485e-a1d0-13007e44ad89 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:11.210729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b6ea9809-55f5-485e-a1d0-13007e44ad89 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134081 May 26 18:23:11.210729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 358/704] 10.222.0.46 () {60 vars in 1155 bytes} [Thu May 26 18:23:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:23:11.216671 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-95ee44d8-9665-4761-b398-728174609455 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Action: 'create', calling method: .version_select at 0x7f5f18c17af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-144748024", "metadata": {"Type": "work"}}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-95ee44d8-9665-4761-b398-728174609455 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Request method failure captured: May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 119 May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8WOGoVgXq3_puFw-sUnSTH7IPyDvctE0TXKcR-QBCLataIrQWWQWHPYFmWrdBOCiu_GsHsifMdj2TNBLI_iZQNvkSs1FCdIh5KDJS6Lq-1Ch2HN4fVYYZ6aLz5Y7zpnv7oLg6pXIXjWL0odw04fMTM_HqB7_1sAKxdN7p4wIltCD04 May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:23:11.219949 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_97f9489fba044b7ab4a27b197b017b06", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 87efe160534a48cdb253dd24245213e4 May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-144748024", "metadata": {"Type": "work"}}} May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: May 26 18:23:11.221447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-144748024', 'metadata': {'Type': 'work'}}}} May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise error May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi '0' May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:11.222545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:23:11.224087 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:23:11.225650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:23:11.225650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.225650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-95ee44d8-9665-4761-b398-728174609455 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:11.225650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-95ee44d8-9665-4761-b398-728174609455 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009022 May 26 18:23:11.225650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 347/705] 10.222.0.46 () {60 vars in 1155 bytes} [Thu May 26 18:23:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:23:11.230494 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-019968eb-6e0d-4300-a395-ba408a507ce9 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Action: 'create', calling method: .version_select at 0x7f5f183b93a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1143705464", "metadata": {"Type": "work"}}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-019968eb-6e0d-4300-a395-ba408a507ce9 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Request method failure captured: May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 119 May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8WOGoVgXq3_puFw-sUnSTH7IPyDvctE0TXKcR-QBCLataIrQWWQWHPYFmWrdBOCiu_GsHsifMdj2TNBLI_iZQNvkSs1FCdIh5KDJS6Lq-1Ch2HN4fVYYZ6aLz5Y7zpnv7oLg6pXIXjWL0odw04fMTM_HqB7_1sAKxdN7p4wIltCD04 May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:23:11.232782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_97f9489fba044b7ab4a27b197b017b06", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 87efe160534a48cdb253dd24245213e4 May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1143705464", "metadata": {"Type": "work"}}} May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: May 26 18:23:11.234275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1143705464', 'metadata': {'Type': 'work'}}}} May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise error May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi '' May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:11.235359 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:23:11.236922 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:23:11.238352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:23:11.238352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.238352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-019968eb-6e0d-4300-a395-ba408a507ce9 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:11.238352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-019968eb-6e0d-4300-a395-ba408a507ce9 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007563 May 26 18:23:11.238352 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 359/706] 10.222.0.46 () {60 vars in 1155 bytes} [Thu May 26 18:23:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:23:11.244734 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1a05b421-c835-40d1-9eca-49dbe3bd5500 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Calling method '.version_select at 0x7f5f18ccf4c0>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:11.276198 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-1a05b421-c835-40d1-9eca-49dbe3bd5500 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] HTTP exception thrown: Volume tempest-invalid-2031432794 could not be found. May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1a05b421-c835-40d1-9eca-49dbe3bd5500 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Request method failure captured: May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2031432794 HTTP/1.1 May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8WOGoVgXq3_puFw-sUnSTH7IPyDvctE0TXKcR-QBCLataIrQWWQWHPYFmWrdBOCiu_GsHsifMdj2TNBLI_iZQNvkSs1FCdIh5KDJS6Lq-1Ch2HN4fVYYZ6aLz5Y7zpnv7oLg6pXIXjWL0odw04fMTM_HqB7_1sAKxdN7p4wIltCD04 May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:23:11.278321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_97f9489fba044b7ab4a27b197b017b06", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 87efe160534a48cdb253dd24245213e4 May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Volume tempest-invalid-2031432794 could not be found. May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'tempest-invalid-2031432794'} May 26 18:23:11.280023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2031432794 could not be found. (HTTP 404) (Request-ID: req-0df09f45-f6f0-4ac3-b9d3-b4a179bc1179) May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.280834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:23:11.282006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2031432794 could not be found. May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:23:11.283080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2031432794 could not be found. May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2031432794 could not be found. May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1a05b421-c835-40d1-9eca-49dbe3bd5500 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Returning 404 to user: Volume tempest-invalid-2031432794 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1a05b421-c835-40d1-9eca-49dbe3bd5500 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2031432794" status: 404 len: 99 microversion: 2.1 time: 0.040154 May 26 18:23:11.284295 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 348/707] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 18:23:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2031432794 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 26 18:23:11.289802 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-904792b2-535d-44c7-8ef3-766f23d5aa41 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004416 May 26 18:23:11.290456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 360/708] 10.222.0.46 () {58 vars in 1139 bytes} [Thu May 26 18:23:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 18:23:11.298801 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-39a8a6d2-9f78-45c7-a528-39b9ed4418a6 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003891 May 26 18:23:11.299287 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 349/709] 10.222.0.46 () {58 vars in 1136 bytes} [Thu May 26 18:23:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 18:23:11.308183 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-326e9fb9-01fb-4885-90bd-28a2185911ea tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Calling method '.version_select at 0x7f5f183b9f70>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:11.336317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-326e9fb9-01fb-4885-90bd-28a2185911ea tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] HTTP exception thrown: Volume caf6416b-e3a4-4811-9874-dc93257761a1 could not be found. May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-326e9fb9-01fb-4885-90bd-28a2185911ea tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Request method failure captured: May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/os-volumes/caf6416b-e3a4-4811-9874-dc93257761a1 HTTP/1.1 May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8WOGoVgXq3_puFw-sUnSTH7IPyDvctE0TXKcR-QBCLataIrQWWQWHPYFmWrdBOCiu_GsHsifMdj2TNBLI_iZQNvkSs1FCdIh5KDJS6Lq-1Ch2HN4fVYYZ6aLz5Y7zpnv7oLg6pXIXjWL0odw04fMTM_HqB7_1sAKxdN7p4wIltCD04 May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:23:11.338537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_97f9489fba044b7ab4a27b197b017b06", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 87efe160534a48cdb253dd24245213e4 May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Volume caf6416b-e3a4-4811-9874-dc93257761a1 could not be found. May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'caf6416b-e3a4-4811-9874-dc93257761a1'} May 26 18:23:11.340051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume caf6416b-e3a4-4811-9874-dc93257761a1 could not be found. (HTTP 404) (Request-ID: req-e93aa51a-6764-4fb1-9ccc-e30838b1da69) May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.341850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:23:11.343129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume caf6416b-e3a4-4811-9874-dc93257761a1 could not be found. May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:23:11.344362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume caf6416b-e3a4-4811-9874-dc93257761a1 could not be found. May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume caf6416b-e3a4-4811-9874-dc93257761a1 could not be found. May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-326e9fb9-01fb-4885-90bd-28a2185911ea tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Returning 404 to user: Volume caf6416b-e3a4-4811-9874-dc93257761a1 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-326e9fb9-01fb-4885-90bd-28a2185911ea tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/caf6416b-e3a4-4811-9874-dc93257761a1" status: 404 len: 109 microversion: 2.1 time: 0.036018 May 26 18:23:11.345776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 361/710] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:23:11 2022] DELETE /compute/v2.1/os-volumes/caf6416b-e3a4-4811-9874-dc93257761a1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:23:11.350757 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b022c239-dfbb-43a5-9f35-349bc11c2de5 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Calling method '.version_select at 0x7f5f18c17160>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:11.378124 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-b022c239-dfbb-43a5-9f35-349bc11c2de5 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] HTTP exception thrown: Volume 4a8b34cc-694c-4ff1-a40c-a8d8f441de4d could not be found. May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b022c239-dfbb-43a5-9f35-349bc11c2de5 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Request method failure captured: May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/os-volumes/4a8b34cc-694c-4ff1-a40c-a8d8f441de4d HTTP/1.1 May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8WOGoVgXq3_puFw-sUnSTH7IPyDvctE0TXKcR-QBCLataIrQWWQWHPYFmWrdBOCiu_GsHsifMdj2TNBLI_iZQNvkSs1FCdIh5KDJS6Lq-1Ch2HN4fVYYZ6aLz5Y7zpnv7oLg6pXIXjWL0odw04fMTM_HqB7_1sAKxdN7p4wIltCD04 May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:23:11.380086 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/97f9489fba044b7ab4a27b197b017b06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_97f9489fba044b7ab4a27b197b017b06", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 97f9489fba044b7ab4a27b197b017b06 May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-VolumesNegativeTest-851982064 May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 87efe160534a48cdb253dd24245213e4 May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-VolumesNegativeTest-851982064-project May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Volume 4a8b34cc-694c-4ff1-a40c-a8d8f441de4d could not be found. May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '4a8b34cc-694c-4ff1-a40c-a8d8f441de4d'} May 26 18:23:11.381637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a8b34cc-694c-4ff1-a40c-a8d8f441de4d could not be found. (HTTP 404) (Request-ID: req-c8236553-5417-4d3d-a785-82632f7653a3) May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.382628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:23:11.384823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a8b34cc-694c-4ff1-a40c-a8d8f441de4d could not be found. May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:23:11.386218 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a8b34cc-694c-4ff1-a40c-a8d8f441de4d could not be found. May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a8b34cc-694c-4ff1-a40c-a8d8f441de4d could not be found. May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b022c239-dfbb-43a5-9f35-349bc11c2de5 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] Returning 404 to user: Volume 4a8b34cc-694c-4ff1-a40c-a8d8f441de4d could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b022c239-dfbb-43a5-9f35-349bc11c2de5 tempest-VolumesNegativeTest-851982064 tempest-VolumesNegativeTest-851982064-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4a8b34cc-694c-4ff1-a40c-a8d8f441de4d" status: 404 len: 109 microversion: 2.1 time: 0.035505 May 26 18:23:11.387581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 350/711] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:23:11 2022] GET /compute/v2.1/os-volumes/4a8b34cc-694c-4ff1-a40c-a8d8f441de4d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:23:12.220226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d9c2a7a8-a830-491d-8c12-89a229ef32d1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:12.220790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d9c2a7a8-a830-491d-8c12-89a229ef32d1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:12.228072 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d9c2a7a8-a830-491d-8c12-89a229ef32d1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:12.228915 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d9c2a7a8-a830-491d-8c12-89a229ef32d1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:12.229691 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d9c2a7a8-a830-491d-8c12-89a229ef32d1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:12.230228 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d9c2a7a8-a830-491d-8c12-89a229ef32d1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:12.253244 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d9c2a7a8-a830-491d-8c12-89a229ef32d1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/ips" status: 200 len: 150 microversion: 2.20 time: 0.037313 May 26 18:23:12.257014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 362/712] 10.222.0.46 () {60 vars in 1288 bytes} [Thu May 26 18:23:12 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:23:14.679822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3a5d5ece-c236-4f13-9ad3-2a75a935b3c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:14.680384 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-3a5d5ece-c236-4f13-9ad3-2a75a935b3c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:14.687351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a5d5ece-c236-4f13-9ad3-2a75a935b3c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:14.687798 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a5d5ece-c236-4f13-9ad3-2a75a935b3c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:14.688564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a5d5ece-c236-4f13-9ad3-2a75a935b3c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:14.689002 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a5d5ece-c236-4f13-9ad3-2a75a935b3c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:14.711901 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-3a5d5ece-c236-4f13-9ad3-2a75a935b3c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lazy-loading 'flavor' on Instance uuid 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:23:14.985572 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-3a5d5ece-c236-4f13-9ad3-2a75a935b3c6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/action" status: 202 len: 0 microversion: 2.20 time: 0.310213 May 26 18:23:14.989466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 351/713] 10.222.0.46 () {62 vars in 1318 bytes} [Thu May 26 18:23:14 2022] POST /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:23:14.996602 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:14.998069 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:15.003053 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:15.007033 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:15.007511 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:15.008752 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:15.009575 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:15.014772 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=100 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:15.148995 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:15.158283 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:15.159796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:15.161066 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fca9adde-79d3-487f-931c-b488a254c062 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.170389 May 26 18:23:15.161654 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 363/714] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:14 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:16.181082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:16.182530 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:16.188965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:16.189418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:16.190204 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:16.190635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:16.329853 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:16.338618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:16.340416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:16.341672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-211228a2-831a-47c6-b8f8-e82ccda4a4b0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.165283 May 26 18:23:16.342347 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 352/715] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:16 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:17.360512 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:17.361597 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:17.368274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:17.368733 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:17.369620 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:17.370079 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:17.510380 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:17.518685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:17.520271 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:17.521443 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a52ebced-c57a-4e11-9f7b-d0f6ba760b73 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.164813 May 26 18:23:17.522049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 364/716] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:17 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:18.540351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:18.541446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:18.548375 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:18.548827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:18.549590 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:18.550056 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:18.690167 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:18.698204 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:18.699705 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:18.700865 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0a1f36a4-e4ba-4dcd-b6a9-bf0f6e2884ab tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.164400 May 26 18:23:18.701510 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 353/717] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:18 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:19.719053 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:19.719671 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:19.726279 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:19.726780 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:19.727635 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:19.728113 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:19.864231 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:19.873130 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:19.874741 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:19.875919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6438b769-0009-4155-ace7-882b054c944b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.160872 May 26 18:23:19.876865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 365/718] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:19 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:20.894815 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:20.895716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:20.898519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=45 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:20.904724 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:20.905173 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:20.906131 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:20.906569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:20.911080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:21.084404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:21.094563 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:21.096091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:21.097360 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-3a4cc8b1-8160-488e-8f4a-09ed8b06c1d9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.206715 May 26 18:23:21.097825 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 354/719] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:20 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:22.117255 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:22.117820 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:22.125054 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:22.125512 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:22.126320 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:22.126764 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:22.257796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:22.266151 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:22.267663 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:22.268840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9173c91a-30f0-4028-a28f-d5833619ec11 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.156981 May 26 18:23:22.279749 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 366/720] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:22 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:23.286435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:23.287036 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:23.294673 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:23.295115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:23.295860 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:23.296287 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:23.426543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:23.434690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:23.436183 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:23.437323 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-3da351df-fb25-4902-9913-5aaee6702b90 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.154750 May 26 18:23:23.437908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 355/721] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:23 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:24.455493 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:24.456112 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:24.462300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:24.462751 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:24.463513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:24.463957 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:24.589086 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:24.597014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:24.598539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:24.599707 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5c1d7874-55eb-42e7-9991-8dab8ec220e9 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.148125 May 26 18:23:24.600254 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 367/722] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:24 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:25.617868 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:25.618423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:25.624939 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:25.625532 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:25.626330 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:25.626764 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:25.753353 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:25.762024 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:25.763536 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:25.764722 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a7fd1572-ab91-4931-9c5a-45cd7f9ffa84 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.150958 May 26 18:23:25.765287 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 356/723] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:25 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:26.783305 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:26.783920 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:26.790590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:26.791047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:26.791944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:26.793002 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:26.923121 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:26.931229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:26.933068 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:26.934281 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bfe480d3-b408-4011-b60b-b57189265fbf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.154977 May 26 18:23:26.934844 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 368/724] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:26 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:27.952517 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:27.953144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:27.959617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:27.960068 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:27.960833 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:27.961269 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:28.088624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:28.098225 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:28.099967 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:28.101310 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1e78f3c1-ad7f-4b7d-bcbd-e31bc4f1c528 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.152914 May 26 18:23:28.101916 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 357/725] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:27 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:29.120212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:29.120908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:29.128606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:29.129125 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:29.129930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:29.130367 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:29.260660 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:29.268714 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:29.270308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:29.271528 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-80439d44-4365-4d0d-b38c-6f9be43bffd0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.155282 May 26 18:23:29.272315 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 369/726] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:29 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:23:30.289543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:30.290286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:30.296913 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:30.297361 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:30.298160 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:30.298593 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:30.512307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:30.520727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:30.522343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:30.523576 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9d79b9ed-07a4-4b78-837c-1b734fddd482 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.238038 May 26 18:23:30.524211 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 358/727] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:30 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:31.251740 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-eed271c9-ea8e-41f4-bceb-32d0131e95f1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:31.252289 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-eed271c9-ea8e-41f4-bceb-32d0131e95f1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:31.258143 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eed271c9-ea8e-41f4-bceb-32d0131e95f1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:31.258531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eed271c9-ea8e-41f4-bceb-32d0131e95f1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:31.259295 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eed271c9-ea8e-41f4-bceb-32d0131e95f1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:31.259727 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eed271c9-ea8e-41f4-bceb-32d0131e95f1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:31.284920 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-eed271c9-ea8e-41f4-bceb-32d0131e95f1 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/ips" status: 200 len: 146 microversion: 2.1 time: 0.280339 May 26 18:23:31.289769 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 370/728] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:23:31 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/ips => generated 146 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:31.543848 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:31.544912 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:31.553793 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:31.555622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:31.557082 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:31.558228 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:31.708421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:31.717162 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:31.718682 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:31.719836 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0cf31b6d-308f-4bae-ae0d-5d49d8bc573f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.180999 May 26 18:23:31.720575 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 359/729] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:31 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:32.661332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ac131de5-f0e9-4266-bb94-39707ed4183e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bf1e69b-d5e2-4db4-a7a2-753d4a63c1d9"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:32.662494 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ac131de5-f0e9-4266-bb94-39707ed4183e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:32.669463 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ac131de5-f0e9-4266-bb94-39707ed4183e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:32.669954 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ac131de5-f0e9-4266-bb94-39707ed4183e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:32.670721 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ac131de5-f0e9-4266-bb94-39707ed4183e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:32.671160 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ac131de5-f0e9-4266-bb94-39707ed4183e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:32.737611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:32.738771 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:32.745203 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:32.745656 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:32.746568 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:32.747922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:32.886963 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:32.902713 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:32.905588 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:32.907720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-02619c9f-d272-4d53-81da-d2bc11afe93a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1740 microversion: 2.20 time: 0.174201 May 26 18:23:32.908347 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 360/730] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:32 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:23:32.922442 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ac131de5-f0e9-4266-bb94-39707ed4183e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264497 May 26 18:23:32.926063 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 371/731] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:23:32 2022] POST /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:33.927832 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:33.928436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:33.935139 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:33.935584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:33.936338 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:33.936771 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:34.071091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:34.079778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:34.081280 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:34.082473 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-53be8b11-6ec6-44e7-a734-1c0d83fcb53b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1740 microversion: 2.20 time: 0.158829 May 26 18:23:34.083038 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 361/732] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:33 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:35.101386 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:35.102050 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:35.109085 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:35.109524 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:35.110318 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:35.110758 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:35.245065 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:35.253149 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:35.254667 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:35.255831 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-24725566-84ca-42c5-a570-728775a6c60e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1740 microversion: 2.20 time: 0.159319 May 26 18:23:35.256390 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 372/733] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:35 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:36.274467 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:36.274993 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:36.282351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:36.282809 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:36.283579 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:36.284022 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:36.410685 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:36.422249 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:36.423786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:36.424945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ff386230-4461-41d2-b41d-6fafeeaec032 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1740 microversion: 2.20 time: 0.154526 May 26 18:23:36.425513 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 362/734] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:36 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:37.443409 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:37.444091 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:37.452076 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:37.452675 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:37.453503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:37.453989 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:37.595257 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:37.604270 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:37.606609 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:37.607948 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a4ee3567-6dcb-4ef8-b628-39aa74e2b71e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.168584 May 26 18:23:37.608499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 373/735] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:37 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:38.629046 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:38.629917 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:38.638216 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:38.638760 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:38.639614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:38.640338 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:38.782228 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:38.790433 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:38.791934 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:38.793141 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d40fdb15-8259-484d-a13b-ff8158c0010e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.169842 May 26 18:23:38.793707 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 363/736] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:38 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:39.313745 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-86139ff3-c6df-4c07-a948-ee8739b4551f req-7b997dc8-2b58-4b8a-ba54-1eddafb58ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f119e1-cd1f-4c56-bfed-f0d172ba0c8b", "name": "network-vif-plugged", "status": "completed", "tag": "889d39d4-d8a9-413d-850d-667746898381"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:39.326564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-86139ff3-c6df-4c07-a948-ee8739b4551f req-7b997dc8-2b58-4b8a-ba54-1eddafb58ab2 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:39.327302 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-86139ff3-c6df-4c07-a948-ee8739b4551f req-7b997dc8-2b58-4b8a-ba54-1eddafb58ab2 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:39.340575 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-86139ff3-c6df-4c07-a948-ee8739b4551f req-7b997dc8-2b58-4b8a-ba54-1eddafb58ab2 service nova] Creating event network-vif-plugged:889d39d4-d8a9-413d-850d-667746898381 for instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b on hv-cinder-84349 May 26 18:23:39.348652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-86139ff3-c6df-4c07-a948-ee8739b4551f req-7b997dc8-2b58-4b8a-ba54-1eddafb58ab2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195242 May 26 18:23:39.351101 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 374/737] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:39.811864 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:39.813255 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:39.820289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:39.820734 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:39.821742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:39.822180 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:39.991704 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:40.005385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:40.006925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:40.008127 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-bfff88e3-3aeb-435f-8ce9-35289d841683 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.200554 May 26 18:23:40.017911 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 364/738] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:39 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:41.030964 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:41.032451 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:41.048654 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:41.049116 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:41.049944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:41.054314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:41.212653 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:41.222788 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:41.224615 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:41.226123 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-73d6685a-5280-49e4-ae25-74c0b026f181 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.202622 May 26 18:23:41.236824 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 375/739] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:41 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:42.244418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:42.244952 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:42.252252 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:42.252958 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:42.253749 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:42.254360 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:42.405112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:42.413535 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:42.415097 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:42.416260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-80231a79-45d8-4175-9d9c-02ae06e476da tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.176374 May 26 18:23:42.417011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 365/740] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:42 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:42.677149 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fa89a3bd-7885-40ef-8abc-a3883a8d9c9e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:42.678591 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fa89a3bd-7885-40ef-8abc-a3883a8d9c9e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:42.689458 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa89a3bd-7885-40ef-8abc-a3883a8d9c9e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:42.690283 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa89a3bd-7885-40ef-8abc-a3883a8d9c9e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:42.691075 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa89a3bd-7885-40ef-8abc-a3883a8d9c9e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:42.692142 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa89a3bd-7885-40ef-8abc-a3883a8d9c9e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:42.724371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fa89a3bd-7885-40ef-8abc-a3883a8d9c9e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051770 May 26 18:23:42.725308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 376/741] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:23:42 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:42.735447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-60080ab4-554e-4e64-a1da-eae0246153bf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:42.736038 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-60080ab4-554e-4e64-a1da-eae0246153bf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:42.745666 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-60080ab4-554e-4e64-a1da-eae0246153bf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:42.746320 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-60080ab4-554e-4e64-a1da-eae0246153bf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:42.747169 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-60080ab4-554e-4e64-a1da-eae0246153bf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:42.747680 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-60080ab4-554e-4e64-a1da-eae0246153bf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:42.780749 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-60080ab4-554e-4e64-a1da-eae0246153bf tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/4bf1e69b-d5e2-4db4-a7a2-753d4a63c1d9" status: 200 len: 194 microversion: 2.1 time: 0.049133 May 26 18:23:42.781600 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 366/742] 10.222.0.46 () {58 vars in 1412 bytes} [Thu May 26 18:23:42 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/4bf1e69b-d5e2-4db4-a7a2-753d4a63c1d9 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:43.436354 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:43.437021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:43.445599 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:43.446393 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:43.447546 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:43.448268 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:43.623177 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:43.641958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:43.641958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:43.641958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7b977df4-be2d-45ff-be63-af6d5f61c0bd tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.209317 May 26 18:23:43.642298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 377/743] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:43 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:44.199617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cde421cf-e00b-4631-ad94-14a517171b75 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6e3764a-9f68-433a-a760-157a32315981"}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:44.201353 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-cde421cf-e00b-4631-ad94-14a517171b75 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:44.208465 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cde421cf-e00b-4631-ad94-14a517171b75 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:44.209045 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cde421cf-e00b-4631-ad94-14a517171b75 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:44.209961 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cde421cf-e00b-4631-ad94-14a517171b75 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:44.210511 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cde421cf-e00b-4631-ad94-14a517171b75 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:44.531268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-cde421cf-e00b-4631-ad94-14a517171b75 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "POST /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335828 May 26 18:23:44.532570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 367/744] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:23:44 2022] POST /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:44.659335 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:44.660658 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:44.674299 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:44.675419 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:44.678267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:44.679342 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:44.997510 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:45.006308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:45.009622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:45.012321 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f8d2ee74-d258-4aca-b437-a533d8513c06 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.357449 May 26 18:23:45.023953 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 378/745] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:44 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:46.032820 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:46.033524 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:46.040285 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:46.040737 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:46.041507 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:46.041987 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:46.188814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:46.197275 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:46.199506 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:46.201094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5f489fa5-0784-412d-ac8d-7cd8693064a2 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.172803 May 26 18:23:46.203088 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 368/746] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:46 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:47.221230 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:47.222027 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:47.227976 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=32 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:47.229409 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:47.229877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:47.231020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:47.231464 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:47.235019 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:47.367444 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:47.375844 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:47.377382 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:47.378682 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3395db63-662c-4054-9133-b6e37fc1d17d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.161363 May 26 18:23:47.379248 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 379/747] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:47 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:48.397527 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:48.398176 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:48.405366 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:48.405845 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:48.406603 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:48.407039 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:48.422078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:48.544170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:48.553322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:48.554911 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:48.556067 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-cf24fc1e-2028-4a56-b46a-f85dd5d2b1bf tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1735 microversion: 2.20 time: 0.162450 May 26 18:23:48.556638 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 369/748] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:48 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:49.170986 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d5365671-f3b1-47e5-b88c-351208c9601e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:49.171558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d5365671-f3b1-47e5-b88c-351208c9601e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:49.177992 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5365671-f3b1-47e5-b88c-351208c9601e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:49.178445 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5365671-f3b1-47e5-b88c-351208c9601e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:49.179207 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5365671-f3b1-47e5-b88c-351208c9601e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:49.179641 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d5365671-f3b1-47e5-b88c-351208c9601e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:49.203669 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d5365671-f3b1-47e5-b88c-351208c9601e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/ips" status: 200 len: 150 microversion: 2.1 time: 0.036515 May 26 18:23:49.204242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 380/749] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:23:49 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:49.574419 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:49.575041 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:49.581181 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:49.581635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:49.582449 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:49.582888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:49.712085 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:49.720025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:49.721531 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:49.722719 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6f08a74c-c62b-4d86-993d-2485c2fb9eb6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1717 microversion: 2.20 time: 0.152410 May 26 18:23:49.723292 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 370/750] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:49 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:50.563915 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-07656c5f-b00d-4870-b853-d98b38d896ca tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b4dc351-6c5a-4a51-b101-3222488af08d"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:50.564979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-07656c5f-b00d-4870-b853-d98b38d896ca tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:50.571465 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07656c5f-b00d-4870-b853-d98b38d896ca tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:50.571920 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07656c5f-b00d-4870-b853-d98b38d896ca tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:50.572678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07656c5f-b00d-4870-b853-d98b38d896ca tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:50.573115 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-07656c5f-b00d-4870-b853-d98b38d896ca tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:50.742070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:50.742960 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:50.750833 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:50.751381 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:50.752651 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:50.752740 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:50.910961 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:50.919680 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:50.921213 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:50.922429 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-511e15ba-5ba2-40d9-95b7-e38141910332 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1717 microversion: 2.20 time: 0.184472 May 26 18:23:50.922996 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 371/751] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:50 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1717 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:23:50.927613 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-31a03d25-5393-4f4d-9d1b-6cefa27aacf5 req-db504e31-44ce-464c-859e-51212393004e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f119e1-cd1f-4c56-bfed-f0d172ba0c8b", "name": "network-vif-unplugged", "status": "completed", "tag": "889d39d4-d8a9-413d-850d-667746898381"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:50.931062 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=36 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:50.943854 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-31a03d25-5393-4f4d-9d1b-6cefa27aacf5 req-db504e31-44ce-464c-859e-51212393004e service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:50.944530 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-31a03d25-5393-4f4d-9d1b-6cefa27aacf5 req-db504e31-44ce-464c-859e-51212393004e service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:50.960061 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-31a03d25-5393-4f4d-9d1b-6cefa27aacf5 req-db504e31-44ce-464c-859e-51212393004e service nova] Creating event network-vif-unplugged:889d39d4-d8a9-413d-850d-667746898381 for instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b on hv-cinder-84349 May 26 18:23:50.965429 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-31a03d25-5393-4f4d-9d1b-6cefa27aacf5 req-db504e31-44ce-464c-859e-51212393004e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040982 May 26 18:23:50.966902 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 372/752] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:51.385472 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-07656c5f-b00d-4870-b853-d98b38d896ca tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "POST /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825973 May 26 18:23:51.386162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 381/753] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:23:50 2022] POST /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:23:51.942311 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:51.943015 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:51.949132 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:51.949580 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:51.950961 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:51.951421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:52.163856 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:52.174848 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:52.176612 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:52.177813 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-94fe7a80-dd19-47c6-9765-bd702f5fb252 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1720 microversion: 2.20 time: 0.240180 May 26 18:23:52.178378 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 373/754] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:51 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:52.196900 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5cb18be0-cae8-47b8-9d07-385565ffaf42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65630e5b-37d7-4e9c-8670-3b120776a740"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:52.198154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5cb18be0-cae8-47b8-9d07-385565ffaf42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:52.205632 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5cb18be0-cae8-47b8-9d07-385565ffaf42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:52.206118 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5cb18be0-cae8-47b8-9d07-385565ffaf42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:52.206890 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5cb18be0-cae8-47b8-9d07-385565ffaf42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:52.207330 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5cb18be0-cae8-47b8-9d07-385565ffaf42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:52.516085 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5cb18be0-cae8-47b8-9d07-385565ffaf42 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323462 May 26 18:23:52.517103 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 382/755] 10.222.0.46 () {62 vars in 1363 bytes} [Thu May 26 18:23:52 2022] POST /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:23:52.640889 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9d326f0d-658f-4a53-b69c-9a13e5cb0990 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:52.641763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9d326f0d-658f-4a53-b69c-9a13e5cb0990 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:52.648311 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9d326f0d-658f-4a53-b69c-9a13e5cb0990 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:52.648967 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9d326f0d-658f-4a53-b69c-9a13e5cb0990 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:52.649763 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9d326f0d-658f-4a53-b69c-9a13e5cb0990 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:52.650671 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9d326f0d-658f-4a53-b69c-9a13e5cb0990 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:52.897766 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9d326f0d-658f-4a53-b69c-9a13e5cb0990 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "DELETE /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/os-volume_attachments/65630e5b-37d7-4e9c-8670-3b120776a740" status: 202 len: 0 microversion: 2.20 time: 0.261328 May 26 18:23:52.898358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 374/756] 10.222.0.46 () {60 vars in 1456 bytes} [Thu May 26 18:23:52 2022] DELETE /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/os-volume_attachments/65630e5b-37d7-4e9c-8670-3b120776a740 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:23:52.958349 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f54269d4-6095-4c14-86f0-27feb0b9cf49 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:23:52.958929 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f54269d4-6095-4c14-86f0-27feb0b9cf49 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:52.967198 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f54269d4-6095-4c14-86f0-27feb0b9cf49 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:52.967653 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f54269d4-6095-4c14-86f0-27feb0b9cf49 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:52.968850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f54269d4-6095-4c14-86f0-27feb0b9cf49 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:52.969298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f54269d4-6095-4c14-86f0-27feb0b9cf49 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.176880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f54269d4-6095-4c14-86f0-27feb0b9cf49 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "POST /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/action" status: 202 len: 0 microversion: 2.20 time: 0.222118 May 26 18:23:53.181287 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5beb3bb0-c968-4c48-8be2-b98978766b78 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:53.181994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 383/757] 10.222.0.46 () {62 vars in 1318 bytes} [Thu May 26 18:23:52 2022] POST /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:23:53.182366 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-5beb3bb0-c968-4c48-8be2-b98978766b78 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:53.187985 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:53.188952 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:53.190866 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5beb3bb0-c968-4c48-8be2-b98978766b78 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:53.191392 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5beb3bb0-c968-4c48-8be2-b98978766b78 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.192327 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5beb3bb0-c968-4c48-8be2-b98978766b78 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:53.192881 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5beb3bb0-c968-4c48-8be2-b98978766b78 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.198488 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:53.199094 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.199879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:53.202276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.228821 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5beb3bb0-c968-4c48-8be2-b98978766b78 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053597 May 26 18:23:53.233860 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 375/758] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:23:53 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:23:53.357639 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:53.367253 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:53.370904 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:53.372667 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-af3a33b9-e94f-46cf-8d1f-072a66edbd60 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1668 microversion: 2.20 time: 0.189332 May 26 18:23:53.373541 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 384/759] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:53 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:53.377607 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a61ba579-3138-4ff5-aec3-0f18dbcb63fd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:53.378143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a61ba579-3138-4ff5-aec3-0f18dbcb63fd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:53.385444 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a61ba579-3138-4ff5-aec3-0f18dbcb63fd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:53.385943 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a61ba579-3138-4ff5-aec3-0f18dbcb63fd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.386717 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a61ba579-3138-4ff5-aec3-0f18dbcb63fd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:53.387158 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a61ba579-3138-4ff5-aec3-0f18dbcb63fd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.419533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a61ba579-3138-4ff5-aec3-0f18dbcb63fd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/4bf1e69b-d5e2-4db4-a7a2-753d4a63c1d9" status: 200 len: 194 microversion: 2.1 time: 0.047556 May 26 18:23:53.420144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 376/760] 10.222.0.46 () {58 vars in 1412 bytes} [Thu May 26 18:23:53 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/4bf1e69b-d5e2-4db4-a7a2-753d4a63c1d9 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:23:53.430334 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c9b90544-d529-4dcd-b0b6-e2dc6c0ddd11 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:53.430843 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c9b90544-d529-4dcd-b0b6-e2dc6c0ddd11 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:53.437404 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9b90544-d529-4dcd-b0b6-e2dc6c0ddd11 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:53.437905 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9b90544-d529-4dcd-b0b6-e2dc6c0ddd11 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.438679 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9b90544-d529-4dcd-b0b6-e2dc6c0ddd11 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:53.439293 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9b90544-d529-4dcd-b0b6-e2dc6c0ddd11 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:53.528388 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-c9b90544-d529-4dcd-b0b6-e2dc6c0ddd11 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lazy-loading 'services' on Instance uuid d34599fe-7096-4f0a-a115-f975c3cbee2c {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:23:53.637981 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c9b90544-d529-4dcd-b0b6-e2dc6c0ddd11 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/4bf1e69b-d5e2-4db4-a7a2-753d4a63c1d9" status: 202 len: 0 microversion: 2.1 time: 0.211530 May 26 18:23:53.638878 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 385/761] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:23:53 2022] DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/4bf1e69b-d5e2-4db4-a7a2-753d4a63c1d9 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:23:54.392094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:54.392706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:54.399259 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:54.399941 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:54.400751 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:54.401194 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:54.539533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:54.548210 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:54.549740 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:54.550967 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-945c3816-4d41-458b-8d12-5939aee3ef9e tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1668 microversion: 2.20 time: 0.163543 May 26 18:23:54.551782 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 377/762] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:54 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:55.570632 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:55.571457 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:55.578616 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:55.579057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:55.579986 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:55.580507 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:55.729220 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:55.737816 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:55.739328 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:55.740502 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-eb6e5aca-75d9-4456-975c-7612dca6c901 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.174727 May 26 18:23:55.741055 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 386/763] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:55 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:56.769112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:56.769832 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:56.785002 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:56.785466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:56.786270 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:56.786702 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:56.962741 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:56.972363 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:56.974839 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:56.976664 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a0eb18b4-d894-4f1a-a8bc-aebf43c69b5c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.220173 May 26 18:23:56.977547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 378/764] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:56 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:57.998664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:57.999452 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:58.008330 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:58.009000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:58.010027 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:58.010702 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:58.207572 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:58.219007 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:58.221181 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:58.223124 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-50a270d5-c8d4-467a-813e-25dc0c6c0e91 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.229878 May 26 18:23:58.234028 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 387/765] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:57 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:23:59.242878 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:23:59.243574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:23:59.251774 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:59.258162 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:59.259043 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:23:59.259489 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:23:59.487427 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:59.499085 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:59.501021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:23:59.502697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-57c8fd87-3222-4874-ba1a-c38c78099519 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.264412 May 26 18:23:59.514007 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 379/766] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:23:59 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:00.521051 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:00.521590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:00.529340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:00.529786 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:00.530549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:00.530993 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:00.684242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:00.693648 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:00.695758 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:00.697132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b361a33c-d644-4f48-b354-067d4b412048 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.180567 May 26 18:24:00.697999 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 388/767] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:00 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:01.716750 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:01.718201 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:01.730062 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:01.732814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:01.733883 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:01.734685 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:02.170495 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:02.180612 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:02.184085 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:02.186324 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f4069b7f-eb3d-4521-a3db-770f612bbaa6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.474529 May 26 18:24:02.186888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 380/768] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:01 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:03.205240 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:03.206815 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:03.213979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:03.214436 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:03.215217 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:03.216205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:03.396793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:03.406002 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:03.407544 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:03.409108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b4c025c7-b4dd-4c8d-8347-fc56ff920a1c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.208493 May 26 18:24:03.419689 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 389/769] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:03 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:04.430737 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:04.431358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:04.439339 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:04.439979 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:04.440804 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:04.441242 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:04.588993 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:04.597920 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:04.599436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:04.600622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-83c5ca04-c35b-41a1-8d55-39b2d051ae70 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.174496 May 26 18:24:04.601186 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 381/770] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:04 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:05.620077 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:05.620717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:05.627311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:05.628396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:05.629211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:05.629658 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:05.644449 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:05.769332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:05.780733 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:05.783392 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:05.785335 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8e40fecb-9781-48d8-ad8b-078b9497abd1 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.169216 May 26 18:24:05.785941 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 390/771] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:05 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:06.499618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-fb01a55a-5cdf-4711-849f-efd737dd69bd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:06.500197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-fb01a55a-5cdf-4711-849f-efd737dd69bd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:06.506776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb01a55a-5cdf-4711-849f-efd737dd69bd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.507312 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb01a55a-5cdf-4711-849f-efd737dd69bd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.508222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb01a55a-5cdf-4711-849f-efd737dd69bd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.508789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-fb01a55a-5cdf-4711-849f-efd737dd69bd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.547349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-fb01a55a-5cdf-4711-849f-efd737dd69bd tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/f6e3764a-9f68-433a-a760-157a32315981" status: 200 len: 194 microversion: 2.1 time: 0.052118 May 26 18:24:06.548278 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 382/772] 10.222.0.46 () {58 vars in 1412 bytes} [Thu May 26 18:24:06 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/f6e3764a-9f68-433a-a760-157a32315981 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:06.561269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7afb330b-be32-4179-95d6-6f8938bdf11f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:06.561926 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7afb330b-be32-4179-95d6-6f8938bdf11f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:06.562418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9aa71293-caaa-4ea3-b5e9-9da13c550672 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:06.563192 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9aa71293-caaa-4ea3-b5e9-9da13c550672 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:06.571143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9aa71293-caaa-4ea3-b5e9-9da13c550672 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.571380 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7afb330b-be32-4179-95d6-6f8938bdf11f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.571594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9aa71293-caaa-4ea3-b5e9-9da13c550672 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.572329 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7afb330b-be32-4179-95d6-6f8938bdf11f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.572431 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9aa71293-caaa-4ea3-b5e9-9da13c550672 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.572777 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9aa71293-caaa-4ea3-b5e9-9da13c550672 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.573800 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7afb330b-be32-4179-95d6-6f8938bdf11f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.574328 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7afb330b-be32-4179-95d6-6f8938bdf11f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.663821 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-9aa71293-caaa-4ea3-b5e9-9da13c550672 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'services' on Instance uuid 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:24:06.667341 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:06.669014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-7afb330b-be32-4179-95d6-6f8938bdf11f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lazy-loading 'services' on Instance uuid d34599fe-7096-4f0a-a115-f975c3cbee2c {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:24:06.743985 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9aa71293-caaa-4ea3-b5e9-9da13c550672 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-volume_attachments/7b4dc351-6c5a-4a51-b101-3222488af08d" status: 202 len: 0 microversion: 2.1 time: 0.187682 May 26 18:24:06.744570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 383/773] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:24:06 2022] DELETE /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-volume_attachments/7b4dc351-6c5a-4a51-b101-3222488af08d => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:24:06.757108 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-97ba1e3d-7afe-49ed-81e2-f4e2434d0802 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:06.758772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-97ba1e3d-7afe-49ed-81e2-f4e2434d0802 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:06.767519 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7afb330b-be32-4179-95d6-6f8938bdf11f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/f6e3764a-9f68-433a-a760-157a32315981" status: 202 len: 0 microversion: 2.1 time: 0.211313 May 26 18:24:06.768724 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 391/774] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:24:06 2022] DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments/f6e3764a-9f68-433a-a760-157a32315981 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:24:06.769116 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97ba1e3d-7afe-49ed-81e2-f4e2434d0802 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.770121 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97ba1e3d-7afe-49ed-81e2-f4e2434d0802 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.771761 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97ba1e3d-7afe-49ed-81e2-f4e2434d0802 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.772804 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97ba1e3d-7afe-49ed-81e2-f4e2434d0802 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.813884 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:06.815525 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:06.824444 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.824646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-97ba1e3d-7afe-49ed-81e2-f4e2434d0802 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073463 May 26 18:24:06.826323 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.828317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:06.829105 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:06.830142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 384/775] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:24:06 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:06.998304 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:07.012057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:07.016404 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:07.018741 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c665e259-be40-45c7-a55d-a4aa9b5ddfe6 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.217601 May 26 18:24:07.019532 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 392/776] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:06 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:07.836517 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-34703345-e398-4a0a-b378-dfa4cc1971f9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:07.837434 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-34703345-e398-4a0a-b378-dfa4cc1971f9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:07.844636 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-34703345-e398-4a0a-b378-dfa4cc1971f9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:07.845089 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-34703345-e398-4a0a-b378-dfa4cc1971f9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:07.845889 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-34703345-e398-4a0a-b378-dfa4cc1971f9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:07.846331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-34703345-e398-4a0a-b378-dfa4cc1971f9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:07.874798 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-34703345-e398-4a0a-b378-dfa4cc1971f9 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042197 May 26 18:24:07.875353 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 385/777] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:24:07 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:24:07.936433 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-72bed184-6991-48cd-be5f-2159a30fd6b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:07.937176 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-72bed184-6991-48cd-be5f-2159a30fd6b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:07.945699 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-72bed184-6991-48cd-be5f-2159a30fd6b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:07.946375 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-72bed184-6991-48cd-be5f-2159a30fd6b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:07.947258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-72bed184-6991-48cd-be5f-2159a30fd6b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:07.947777 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-72bed184-6991-48cd-be5f-2159a30fd6b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:07.975662 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-72bed184-6991-48cd-be5f-2159a30fd6b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:24:08.039580 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:08.040112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:08.047144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:08.047601 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:08.048365 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:08.048795 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:08.061236 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-72bed184-6991-48cd-be5f-2159a30fd6b5 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 204 len: 0 microversion: 2.1 time: 0.128479 May 26 18:24:08.064779 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 393/778] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:24:07 2022] DELETE /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:24:08.072591 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8f68e07d-28ec-4f8b-9321-bdd9e4977420 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:08.073300 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8f68e07d-28ec-4f8b-9321-bdd9e4977420 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:08.079948 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f68e07d-28ec-4f8b-9321-bdd9e4977420 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:08.080407 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f68e07d-28ec-4f8b-9321-bdd9e4977420 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:08.081179 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f68e07d-28ec-4f8b-9321-bdd9e4977420 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:08.081621 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f68e07d-28ec-4f8b-9321-bdd9e4977420 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:08.250467 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:08.258153 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8f68e07d-28ec-4f8b-9321-bdd9e4977420 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:08.261004 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:08.263251 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:08.264443 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e60f7e88-de28-4487-b12b-537689be374f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.228726 May 26 18:24:08.265005 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 386/779] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:08 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:24:08.268130 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8f68e07d-28ec-4f8b-9321-bdd9e4977420 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1681 microversion: 2.1 time: 0.199894 May 26 18:24:08.269133 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 394/780] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:08 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:24:08.892170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-9466bff0-33ae-41cc-843f-43b996b0389d req-bdf50484-e00d-4ffe-bac6-028b26c4eeba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f119e1-cd1f-4c56-bfed-f0d172ba0c8b", "name": "network-vif-plugged", "status": "completed", "tag": "889d39d4-d8a9-413d-850d-667746898381"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:24:08.901109 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-9466bff0-33ae-41cc-843f-43b996b0389d req-bdf50484-e00d-4ffe-bac6-028b26c4eeba service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:08.901570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-9466bff0-33ae-41cc-843f-43b996b0389d req-bdf50484-e00d-4ffe-bac6-028b26c4eeba service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:08.914217 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-9466bff0-33ae-41cc-843f-43b996b0389d req-bdf50484-e00d-4ffe-bac6-028b26c4eeba service nova] Creating event network-vif-plugged:889d39d4-d8a9-413d-850d-667746898381 for instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b on hv-cinder-84349 May 26 18:24:08.919092 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-9466bff0-33ae-41cc-843f-43b996b0389d req-bdf50484-e00d-4ffe-bac6-028b26c4eeba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030553 May 26 18:24:08.919827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 387/781] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:09.089937 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-619185a2-1ce5-4c68-8d02-a9b2f0ee3793 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:09.091856 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-619185a2-1ce5-4c68-8d02-a9b2f0ee3793 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:09.098381 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-619185a2-1ce5-4c68-8d02-a9b2f0ee3793 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.098828 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-619185a2-1ce5-4c68-8d02-a9b2f0ee3793 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.099582 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-619185a2-1ce5-4c68-8d02-a9b2f0ee3793 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.100014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-619185a2-1ce5-4c68-8d02-a9b2f0ee3793 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.128340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-619185a2-1ce5-4c68-8d02-a9b2f0ee3793 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042520 May 26 18:24:09.128889 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 395/782] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:24:09 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:24:09.236571 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d4ef68d7-788e-4c61-bc67-d5697f2c953e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:09.237585 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d4ef68d7-788e-4c61-bc67-d5697f2c953e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:09.243863 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d4ef68d7-788e-4c61-bc67-d5697f2c953e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.244316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d4ef68d7-788e-4c61-bc67-d5697f2c953e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.245130 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d4ef68d7-788e-4c61-bc67-d5697f2c953e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.245514 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d4ef68d7-788e-4c61-bc67-d5697f2c953e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.275815 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d4ef68d7-788e-4c61-bc67-d5697f2c953e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043395 May 26 18:24:09.276651 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 388/783] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 18:24:09 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:24:09.286810 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-15d2816e-e4f6-47e7-ba31-9de2c3a5d04b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:09.287437 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-15d2816e-e4f6-47e7-ba31-9de2c3a5d04b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:09.287918 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:09.288540 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:09.293540 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-15d2816e-e4f6-47e7-ba31-9de2c3a5d04b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.294031 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-15d2816e-e4f6-47e7-ba31-9de2c3a5d04b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.295006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-15d2816e-e4f6-47e7-ba31-9de2c3a5d04b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.295447 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-15d2816e-e4f6-47e7-ba31-9de2c3a5d04b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.302276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.302738 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.303627 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.304068 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.595440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:09.603593 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:09.605141 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:09.606874 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-56608455-73c7-43b5-8ea7-e189cdf53b54 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.325532 May 26 18:24:09.607635 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 396/784] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:09 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:09.608663 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-15d2816e-e4f6-47e7-ba31-9de2c3a5d04b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:09.617169 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-15d2816e-e4f6-47e7-ba31-9de2c3a5d04b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1681 microversion: 2.1 time: 0.334313 May 26 18:24:09.617999 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 389/785] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:09 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:09.624493 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-418ba0e5-b3ee-4b66-aa86-9b84395d092e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:09.624994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-418ba0e5-b3ee-4b66-aa86-9b84395d092e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:09.630934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-418ba0e5-b3ee-4b66-aa86-9b84395d092e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.631388 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-418ba0e5-b3ee-4b66-aa86-9b84395d092e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.632164 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-418ba0e5-b3ee-4b66-aa86-9b84395d092e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.632602 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-418ba0e5-b3ee-4b66-aa86-9b84395d092e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.657842 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-418ba0e5-b3ee-4b66-aa86-9b84395d092e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:24:09.735525 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-418ba0e5-b3ee-4b66-aa86-9b84395d092e tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 204 len: 0 microversion: 2.1 time: 0.117156 May 26 18:24:09.736313 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 397/786] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:24:09 2022] DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:24:09.744605 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9a121ca5-3189-4131-8a66-822434254b37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:09.745324 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9a121ca5-3189-4131-8a66-822434254b37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:09.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9a121ca5-3189-4131-8a66-822434254b37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.752750 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9a121ca5-3189-4131-8a66-822434254b37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.753582 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9a121ca5-3189-4131-8a66-822434254b37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:09.754116 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9a121ca5-3189-4131-8a66-822434254b37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:09.993204 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9a121ca5-3189-4131-8a66-822434254b37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:10.000962 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9a121ca5-3189-4131-8a66-822434254b37 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1673 microversion: 2.1 time: 0.260182 May 26 18:24:10.001572 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 390/787] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:09 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:10.627423 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:10.628059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:10.640833 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:10.641289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:10.642311 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:10.642918 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:10.682976 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-a8742e92-d5ac-48be-b1d3-64c3a9c6e3ef req-59165dac-ff76-4c5d-9d74-7a896f65fd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26af75eb-5db2-4a22-94ae-8b9f18a3dd90", "name": "network-vif-deleted", "tag": "753009b3-34ab-4d28-8615-7b4ef5d0174c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:24:10.693295 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-a8742e92-d5ac-48be-b1d3-64c3a9c6e3ef req-59165dac-ff76-4c5d-9d74-7a896f65fd7d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:10.700742 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-a8742e92-d5ac-48be-b1d3-64c3a9c6e3ef req-59165dac-ff76-4c5d-9d74-7a896f65fd7d service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:10.714553 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-a8742e92-d5ac-48be-b1d3-64c3a9c6e3ef req-59165dac-ff76-4c5d-9d74-7a896f65fd7d service nova] Creating event network-vif-deleted:753009b3-34ab-4d28-8615-7b4ef5d0174c for instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 on hv-cinder-84349 May 26 18:24:10.722195 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-a8742e92-d5ac-48be-b1d3-64c3a9c6e3ef req-59165dac-ff76-4c5d-9d74-7a896f65fd7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242573 May 26 18:24:10.723374 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 398/788] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:10.729333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c0519ba5-7700-4e60-a122-081d3e369303 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:10.730162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c0519ba5-7700-4e60-a122-081d3e369303 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:10.739759 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0519ba5-7700-4e60-a122-081d3e369303 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:10.740222 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0519ba5-7700-4e60-a122-081d3e369303 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:10.741008 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0519ba5-7700-4e60-a122-081d3e369303 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:10.741450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c0519ba5-7700-4e60-a122-081d3e369303 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:10.819859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c0519ba5-7700-4e60-a122-081d3e369303 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:10.823566 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:10.828879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c0519ba5-7700-4e60-a122-081d3e369303 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1614 microversion: 2.1 time: 0.104189 May 26 18:24:10.829656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 399/789] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:10 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:10.832899 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:10.834435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:10.835603 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6fb9f745-6ef1-4db7-9fa7-f1d361ee3069 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.214918 May 26 18:24:10.836324 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 391/790] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:10 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:24:11.018388 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b57f1b9d-b9b6-4fda-85fa-393bc514c8f8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:11.018907 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b57f1b9d-b9b6-4fda-85fa-393bc514c8f8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:11.024782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b57f1b9d-b9b6-4fda-85fa-393bc514c8f8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:11.025227 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b57f1b9d-b9b6-4fda-85fa-393bc514c8f8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:11.026001 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b57f1b9d-b9b6-4fda-85fa-393bc514c8f8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:11.026434 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b57f1b9d-b9b6-4fda-85fa-393bc514c8f8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:11.160027 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b57f1b9d-b9b6-4fda-85fa-393bc514c8f8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:11.167943 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b57f1b9d-b9b6-4fda-85fa-393bc514c8f8 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1673 microversion: 2.1 time: 0.153484 May 26 18:24:11.169166 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 400/791] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:11 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:11.846925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:11.847493 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:11.854378 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:11.854571 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:11.855053 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:11.855174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:11.855650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:11.856649 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:11.862684 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:11.863135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:11.863919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:11.864361 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:11.890386 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:11.890832 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:11.891278 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lazy-loading 'fault' on Instance uuid 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:24:11.961005 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da0a5a09a6041d68c5e445af1a492f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4afa4107c4cd2ac0212c45d998801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:11.968585 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-3e552cab-74d4-4681-924a-5b1d9c7f9e79 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 200 len: 1331 microversion: 2.1 time: 0.125653 May 26 18:24:11.969380 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 392/792] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:11 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:12.114759 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:12.126251 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:12.127772 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:12.129625 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-253e24fe-dcc9-4011-8a69-58d2f8160896 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1726 microversion: 2.20 time: 0.279224 May 26 18:24:12.141305 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 401/793] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:11 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1726 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:24:12.186858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2628353a-a564-41a4-9aff-d6af66018656 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:12.187483 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2628353a-a564-41a4-9aff-d6af66018656 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:12.193427 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2628353a-a564-41a4-9aff-d6af66018656 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:12.194204 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2628353a-a564-41a4-9aff-d6af66018656 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:12.195030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2628353a-a564-41a4-9aff-d6af66018656 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:12.195473 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2628353a-a564-41a4-9aff-d6af66018656 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:12.438039 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2628353a-a564-41a4-9aff-d6af66018656 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:12.451820 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2628353a-a564-41a4-9aff-d6af66018656 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1673 microversion: 2.1 time: 0.269252 May 26 18:24:12.452736 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 393/794] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:12 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:12.986517 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:12.987338 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:12.994826 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:12.995855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:12.997445 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:12.998057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:13.014052 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 HTTP/1.1 May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:13.015908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:13.017589 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '26af75eb-5db2-4a22-94ae-8b9f18a3dd90'} May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:13.018645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:13.020162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:13.021597 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:13.022038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7867e487-c30e-435e-ba0f-285fd97677c1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 404 len: 111 microversion: 2.1 time: 0.039437 May 26 18:24:13.023197 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 402/795] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:12 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:13.032178 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6bdb1a28-74d6-47c1-9db9-5111d862cf4a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '.version_select at 0x7f5f18c05700>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:13.054248 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6bdb1a28-74d6-47c1-9db9-5111d862cf4a tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101224730" status: 202 len: 0 microversion: 2.1 time: 0.026325 May 26 18:24:13.064998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 394/796] 10.222.0.46 () {58 vars in 1220 bytes} [Thu May 26 18:24:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101224730 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:24:13.156495 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:13.158779 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:13.170876 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:13.171493 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:13.172419 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:13.173140 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:13.388240 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-3e3860c2-4c80-47e0-9a0a-1fb540da1a93 req-01fe21d0-f443-43a3-8d6e-fb15829f6bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34599fe-7096-4f0a-a115-f975c3cbee2c", "name": "network-vif-deleted", "tag": "17b9f864-286f-441e-acbd-070ab315d197"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:24:13.406660 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-3e3860c2-4c80-47e0-9a0a-1fb540da1a93 req-01fe21d0-f443-43a3-8d6e-fb15829f6bf4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:13.407503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-3e3860c2-4c80-47e0-9a0a-1fb540da1a93 req-01fe21d0-f443-43a3-8d6e-fb15829f6bf4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:13.421930 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-3e3860c2-4c80-47e0-9a0a-1fb540da1a93 req-01fe21d0-f443-43a3-8d6e-fb15829f6bf4 service nova] Creating event network-vif-deleted:17b9f864-286f-441e-acbd-070ab315d197 for instance d34599fe-7096-4f0a-a115-f975c3cbee2c on hv-cinder-84349 May 26 18:24:13.428990 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-3e3860c2-4c80-47e0-9a0a-1fb540da1a93 req-01fe21d0-f443-43a3-8d6e-fb15829f6bf4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044454 May 26 18:24:13.430260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 395/797] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:13.472831 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c37bf899-0d3e-401e-8607-3037961ab4b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:13.473890 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c37bf899-0d3e-401e-8607-3037961ab4b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:13.482251 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c37bf899-0d3e-401e-8607-3037961ab4b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:13.483163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c37bf899-0d3e-401e-8607-3037961ab4b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:13.484145 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c37bf899-0d3e-401e-8607-3037961ab4b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:13.484973 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c37bf899-0d3e-401e-8607-3037961ab4b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:13.495154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:13.508219 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:13.510701 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:13.512263 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e4e5d78b-1608-405b-ba2f-8ef204e9bc2f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1713 microversion: 2.20 time: 0.363667 May 26 18:24:13.513505 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 403/798] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:13 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1713 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:24:13.577665 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c37bf899-0d3e-401e-8607-3037961ab4b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f6932d763461ea26c2d60ed58a59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a09a6e81240889c49b5abb24ab225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:13.586230 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c37bf899-0d3e-401e-8607-3037961ab4b7 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 200 len: 1322 microversion: 2.1 time: 0.119298 May 26 18:24:13.587389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 396/799] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:13 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 1322 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:14.603974 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:14.604594 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:14.611267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:14.611722 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:14.612486 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:14.612926 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:14.626406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] HTTP exception thrown: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Request method failure captured: May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c HTTP/1.1 May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RUeidLLWZvKkIiv5LYe-jCQYVpuqbEhBZll1iy3CuqeHZX_KjrDJT_-gy2d5oJvdHMmOd45SWnZ9NK0R6XgAjoGG3FNo5PWb6PdbQP6ztummbfZhGq6GqBxxTZQ2j8figZwl5TYVnMjlKTdx4tI2YfnHwqPsfb38LJA5CV_8mhOto May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:14.627919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c2a09a6e81240889c49b5abb24ab225", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: a20f6932d763461ea26c2d60ed58a59f May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:14.629564 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'd34599fe-7096-4f0a-a115-f975c3cbee2c'} May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:14.630484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:14.631934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:14.633205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Returning 404 to user: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:14.633205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bced34a4-4265-4bea-8743-1236fc494140 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 404 len: 111 microversion: 2.1 time: 0.029197 May 26 18:24:14.633205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 404/800] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:14 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:24:14.639165 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-debfd4a2-37d7-40d9-900a-e7dbc9cca8f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '.version_select at 0x7f5f18b32b80>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:14.656699 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-debfd4a2-37d7-40d9-900a-e7dbc9cca8f0 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-151836009" status: 202 len: 0 microversion: 2.1 time: 0.022343 May 26 18:24:14.657255 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 397/801] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 18:24:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-151836009 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:24:15.032872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:15.033376 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:15.039706 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:15.040159 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:15.040930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:15.041371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:15.044571 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:15.057135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 HTTP/1.1 May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:15.058725 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.061015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '26af75eb-5db2-4a22-94ae-8b9f18a3dd90'} May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:15.061808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.062994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:15.064184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:15.064184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-611ddab1-bc0b-452e-bc21-c3a06c738df7 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 404 len: 111 microversion: 2.1 time: 0.031840 May 26 18:24:15.064184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 405/802] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:24:15 2022] DELETE /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:15.070107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:15.070720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 26af75eb-5db2-4a22-94ae-8b9f18a3dd90] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:15.076856 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:15.077258 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:15.078049 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:15.078487 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:15.091983 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 HTTP/1.1 May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:15.093672 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.095120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '26af75eb-5db2-4a22-94ae-8b9f18a3dd90'} May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:15.095873 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. May 26 18:24:15.097115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:15.098313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance 26af75eb-5db2-4a22-94ae-8b9f18a3dd90 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:15.098313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-68add937-5cac-40df-af50-21a56ac46834 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90" status: 404 len: 111 microversion: 2.1 time: 0.028955 May 26 18:24:15.098313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 398/803] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:15 2022] GET /compute/v2.1/servers/26af75eb-5db2-4a22-94ae-8b9f18a3dd90 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:16.236895 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:16.237376 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:16.244724 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:16.245172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:16.245962 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:16.247169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:16.260803 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 HTTP/1.1 May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:16.263478 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.265074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'f5e1d369-3bad-49f8-8830-1f1206e60780'} May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:16.265880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.267078 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.268485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:16.268485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c2ae3eac-e74c-4d43-a093-c42cc1e8269b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 404 len: 111 microversion: 2.1 time: 0.031804 May 26 18:24:16.268485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 406/804] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:24:16 2022] DELETE /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:16.273332 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:16.273974 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: f5e1d369-3bad-49f8-8830-1f1206e60780] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:16.280732 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:16.281182 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:16.281978 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:16.282415 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:16.296728 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 HTTP/1.1 May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:16.298286 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.299847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'f5e1d369-3bad-49f8-8830-1f1206e60780'} May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:16.300862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. May 26 18:24:16.302617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.304078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance f5e1d369-3bad-49f8-8830-1f1206e60780 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:16.304078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4c3b3a95-5e57-4a74-821f-a19efe2153ab tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780" status: 404 len: 111 microversion: 2.1 time: 0.030171 May 26 18:24:16.304078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 399/805] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:16 2022] GET /compute/v2.1/servers/f5e1d369-3bad-49f8-8830-1f1206e60780 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:16.308370 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:16.309409 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:16.315505 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:16.315962 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:16.316734 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:16.317189 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:16.331651 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c HTTP/1.1 May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:16.333205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.334760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'dca22358-3d8a-4a3c-a5e9-cb003a11cf2c'} May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:16.335666 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.337132 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:16.338868 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:16.338868 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-93399c9b-799a-4e74-8ff7-d13f6fdd869b tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 404 len: 111 microversion: 2.1 time: 0.030083 May 26 18:24:16.338868 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 407/806] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:24:16 2022] DELETE /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:24:16.343003 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:16.343615 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: dca22358-3d8a-4a3c-a5e9-cb003a11cf2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:16.349780 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:16.350234 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:16.350998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:16.351434 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:16.365396 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c HTTP/1.1 May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:16.366976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.368520 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'dca22358-3d8a-4a3c-a5e9-cb003a11cf2c'} May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:16.369551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. May 26 18:24:16.371029 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:16.373371 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance dca22358-3d8a-4a3c-a5e9-cb003a11cf2c could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:16.373371 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-683d4750-e33a-4ae4-898c-730288c40abd tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c" status: 404 len: 111 microversion: 2.1 time: 0.029239 May 26 18:24:16.373371 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 400/807] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:16 2022] GET /compute/v2.1/servers/dca22358-3d8a-4a3c-a5e9-cb003a11cf2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:17.506189 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:17.506681 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:17.509001 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:17.515568 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:17.516022 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:17.516803 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:17.517847 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:17.533165 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc HTTP/1.1 May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:17.534783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.537483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '158ce769-fde9-413e-81f3-d76b3222b5fc'} May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:17.540100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.542928 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.545229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:17.545229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fb868a61-359f-4e3e-a79e-76461adb61f1 tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "DELETE /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 404 len: 111 microversion: 2.1 time: 0.033921 May 26 18:24:17.545229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 408/808] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:24:17 2022] DELETE /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:17.547080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:17.547654 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:17.549166 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:17.549577 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] [instance: 158ce769-fde9-413e-81f3-d76b3222b5fc] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:17.554386 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:17.554839 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:17.555609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:17.555730 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:17.556053 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:17.556233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:17.557009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:17.557452 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:17.570020 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] HTTP exception thrown: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Request method failure captured: May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c HTTP/1.1 May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RUeidLLWZvKkIiv5LYe-jCQYVpuqbEhBZll1iy3CuqeHZX_KjrDJT_-gy2d5oJvdHMmOd45SWnZ9NK0R6XgAjoGG3FNo5PWb6PdbQP6ztummbfZhGq6GqBxxTZQ2j8figZwl5TYVnMjlKTdx4tI2YfnHwqPsfb38LJA5CV_8mhOto May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:17.571635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c2a09a6e81240889c49b5abb24ab225", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: a20f6932d763461ea26c2d60ed58a59f May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.573120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'd34599fe-7096-4f0a-a115-f975c3cbee2c'} May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:17.575147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.576714 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.578400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Returning 404 to user: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:17.578400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-22c8e00e-bee7-4cef-9343-896ef49fffb4 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 404 len: 111 microversion: 2.1 time: 0.029797 May 26 18:24:17.578590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] HTTP exception thrown: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.578694 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 401/809] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:24:17 2022] DELETE /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Request method failure captured: May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc HTTP/1.1 May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RNGgifj7haPGdtph-xWYaRTqC8Sgtf1JjNTLvCIHtSW5Tg-F6Yx74SZvC0PGs2tBJYFWDEjoX-HrF_3_wvkdWBV2NsSZIOieNKqafDbQvNHoqS2crbLJyjyzSp8S5buyt-i-8yZwgYi6sc4jT4BUliP3-SAyZuETK2r_9zwSVk-B0 May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:17.578783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31b4afa4107c4cd2ac0212c45d998801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31b4afa4107c4cd2ac0212c45d998801", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 31b4afa4107c4cd2ac0212c45d998801 May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74435016 May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 8da0a5a09a6041d68c5e445af1a492f3 May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeNegativeTest-74435016-project May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.580332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '158ce769-fde9-413e-81f3-d76b3222b5fc'} May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:17.581291 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. May 26 18:24:17.583287 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:17.584570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] Returning 404 to user: Instance 158ce769-fde9-413e-81f3-d76b3222b5fc could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:17.584570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0ecc6f48-5745-45c2-8e6d-dfd489bfe47e tempest-AttachVolumeNegativeTest-74435016 tempest-AttachVolumeNegativeTest-74435016-project] 10.222.0.46 "GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc" status: 404 len: 111 microversion: 2.1 time: 0.033555 May 26 18:24:17.584570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 409/810] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:17 2022] GET /compute/v2.1/servers/158ce769-fde9-413e-81f3-d76b3222b5fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:17.585317 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:17.585969 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: d34599fe-7096-4f0a-a115-f975c3cbee2c] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:17.592896 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:17.593353 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:17.594158 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:17.594599 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:17.609317 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] HTTP exception thrown: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Request method failure captured: May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c HTTP/1.1 May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RUeidLLWZvKkIiv5LYe-jCQYVpuqbEhBZll1iy3CuqeHZX_KjrDJT_-gy2d5oJvdHMmOd45SWnZ9NK0R6XgAjoGG3FNo5PWb6PdbQP6ztummbfZhGq6GqBxxTZQ2j8figZwl5TYVnMjlKTdx4tI2YfnHwqPsfb38LJA5CV_8mhOto May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:17.611025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c2a09a6e81240889c49b5abb24ab225", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: a20f6932d763461ea26c2d60ed58a59f May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.612558 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'd34599fe-7096-4f0a-a115-f975c3cbee2c'} May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:17.613436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. May 26 18:24:17.614972 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:17.616291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Returning 404 to user: Instance d34599fe-7096-4f0a-a115-f975c3cbee2c could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:17.616291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f29d4442-5506-4a3e-ac7d-72b63c9a8af3 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c" status: 404 len: 111 microversion: 2.1 time: 0.030799 May 26 18:24:17.616291 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 402/811] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:17 2022] GET /compute/v2.1/servers/d34599fe-7096-4f0a-a115-f975c3cbee2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:18.752471 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:18.753047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:18.759665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:18.760190 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:18.761024 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:18.761530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:18.775798 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] HTTP exception thrown: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Request method failure captured: May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: DELETE /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a HTTP/1.1 May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8RUeidLLWZvKkIiv5LYe-jCQYVpuqbEhBZll1iy3CuqeHZX_KjrDJT_-gy2d5oJvdHMmOd45SWnZ9NK0R6XgAjoGG3FNo5PWb6PdbQP6ztummbfZhGq6GqBxxTZQ2j8figZwl5TYVnMjlKTdx4tI2YfnHwqPsfb38LJA5CV_8mhOto May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:18.778172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c2a09a6e81240889c49b5abb24ab225", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: a20f6932d763461ea26c2d60ed58a59f May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.779859 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '1715d8f6-ce4b-48d3-96b0-0717bc0ac54a'} May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:18.780590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.781771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:18.783070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Returning 404 to user: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:18.783070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7aa1f1a9-27e3-4157-a0c3-8bcff0270ba6 tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 404 len: 111 microversion: 2.1 time: 0.030990 May 26 18:24:18.783070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 410/812] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:24:18 2022] DELETE /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:18.788959 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:18.789570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] [instance: 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:18.796371 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:18.796819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:18.797577 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:18.798034 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:18.812025 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] HTTP exception thrown: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Request method failure captured: May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a HTTP/1.1 May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8RUeidLLWZvKkIiv5LYe-jCQYVpuqbEhBZll1iy3CuqeHZX_KjrDJT_-gy2d5oJvdHMmOd45SWnZ9NK0R6XgAjoGG3FNo5PWb6PdbQP6ztummbfZhGq6GqBxxTZQ2j8figZwl5TYVnMjlKTdx4tI2YfnHwqPsfb38LJA5CV_8mhOto May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:18.813545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c2a09a6e81240889c49b5abb24ab225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c2a09a6e81240889c49b5abb24ab225", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 0c2a09a6e81240889c49b5abb24ab225 May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-740129577 May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: a20f6932d763461ea26c2d60ed58a59f May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeTestJSON-740129577-project May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.815219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '1715d8f6-ce4b-48d3-96b0-0717bc0ac54a'} May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:18.816040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. May 26 18:24:18.817264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:18.818404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] Returning 404 to user: Instance 1715d8f6-ce4b-48d3-96b0-0717bc0ac54a could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:18.818404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-772f29b8-619a-4e0f-bd06-ab9796f6897f tempest-AttachVolumeTestJSON-740129577 tempest-AttachVolumeTestJSON-740129577-project] 10.222.0.46 "GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a" status: 404 len: 111 microversion: 2.1 time: 0.029943 May 26 18:24:18.818404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 403/813] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:24:18 2022] GET /compute/v2.1/servers/1715d8f6-ce4b-48d3-96b0-0717bc0ac54a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:24:23.581882 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-92ea0b59-71d0-4df4-bba5-d6b9d3c742c3 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Action: 'create', calling method: .version_select at 0x7f5f18423a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1435789483", "metadata": {"Type": "work"}}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:24:23.876782 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-92ea0b59-71d0-4df4-bba5-d6b9d3c742c3 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.417640 May 26 18:24:23.877895 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 411/814] 10.222.0.46 () {60 vars in 1155 bytes} [Thu May 26 18:24:23 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 18:24:23.888910 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-99fefe45-fe0a-4e68-b027-6cba4aa743db tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Calling method '.version_select at 0x7f5f18b3e430>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:23.939796 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-99fefe45-fe0a-4e68-b027-6cba4aa743db tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585" status: 200 len: 353 microversion: 2.1 time: 0.055281 May 26 18:24:23.940529 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 404/815] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:24:23 2022] GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:24.953188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-801a661e-4e7c-4e92-a6dd-a8f775ccc7be tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Calling method '.version_select at 0x7f5f18450700>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:25.004485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-801a661e-4e7c-4e92-a6dd-a8f775ccc7be tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585" status: 200 len: 354 microversion: 2.1 time: 0.055892 May 26 18:24:25.005234 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 412/816] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:24:24 2022] GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:25.017391 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-59c7752d-3a6a-4243-ae1e-7aafd8faa024 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Calling method '.version_select at 0x7f5f18b325e0>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:25.065179 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-59c7752d-3a6a-4243-ae1e-7aafd8faa024 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585" status: 200 len: 354 microversion: 2.1 time: 0.052223 May 26 18:24:25.065748 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 405/817] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:24:25 2022] GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:25.076987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7e6bde3d-b640-44ec-ba6c-a74e82504dd1 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Calling method '.version_select at 0x7f5f183f2a60>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:25.136760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7e6bde3d-b640-44ec-ba6c-a74e82504dd1 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585" status: 202 len: 0 microversion: 2.1 time: 0.063541 May 26 18:24:25.137487 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 413/818] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 18:24:25 2022] DELETE /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:24:25.145448 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-85425ede-3d0a-42f2-9d0e-1b44d12e7f4b tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Calling method '.version_select at 0x7f5f18c05e50>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:25.196728 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-85425ede-3d0a-42f2-9d0e-1b44d12e7f4b tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585" status: 200 len: 353 microversion: 2.1 time: 0.055119 May 26 18:24:25.197294 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 406/819] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:24:25 2022] GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:26.210578 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ecfd76c-e0d0-45f6-bb7b-a7352d6d3182 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Calling method '.version_select at 0x7f5f1895e430>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:26.239026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-0ecfd76c-e0d0-45f6-bb7b-a7352d6d3182 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] HTTP exception thrown: Volume e5715d95-3f05-4286-b1d4-360f11125585 could not be found. May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ecfd76c-e0d0-45f6-bb7b-a7352d6d3182 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Request method failure captured: May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585 HTTP/1.1 May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8XXbU-74v1I_C1OIJZUEz83S40ehffwbKYs5ZyGK0J_eSM2Hq-ISMW9JnRPjM6Nj1zkCgYvz6VSP-J4kbUxy2bPmOTAyHtnaxGh2aE6IbrvaUsjNDTO9k7Bpewzw-hHG_Uvn0W8g8T1T4IJmlWwHb8z4wqThf9ChAuKDLZzOw4HzCQ May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 5abd1a9fb52f4ac4aab460faccd3ea13 May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesGetTestJSON-1775874061 May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:26.241026 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5abd1a9fb52f4ac4aab460faccd3ea13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5abd1a9fb52f4ac4aab460faccd3ea13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5abd1a9fb52f4ac4aab460faccd3ea13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5abd1a9fb52f4ac4aab460faccd3ea13", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesGetTestJSON-1775874061 May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 5abd1a9fb52f4ac4aab460faccd3ea13 May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesGetTestJSON-1775874061 May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesGetTestJSON-1775874061-project May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: f5c71a6ae5eb49ce86c4a2513686fce1 May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesGetTestJSON-1775874061-project May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Volume e5715d95-3f05-4286-b1d4-360f11125585 could not be found. May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'e5715d95-3f05-4286-b1d4-360f11125585'} May 26 18:24:26.242509 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e5715d95-3f05-4286-b1d4-360f11125585 could not be found. (HTTP 404) (Request-ID: req-74384da8-e8f0-4a3f-881a-bc87989fe03e) May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:26.243547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:24:26.244994 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e5715d95-3f05-4286-b1d4-360f11125585 could not be found. May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:24:26.247148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e5715d95-3f05-4286-b1d4-360f11125585 could not be found. May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e5715d95-3f05-4286-b1d4-360f11125585 could not be found. May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0ecfd76c-e0d0-45f6-bb7b-a7352d6d3182 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] Returning 404 to user: Volume e5715d95-3f05-4286-b1d4-360f11125585 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0ecfd76c-e0d0-45f6-bb7b-a7352d6d3182 tempest-VolumesGetTestJSON-1775874061 tempest-VolumesGetTestJSON-1775874061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585" status: 404 len: 109 microversion: 2.1 time: 0.036627 May 26 18:24:26.248506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 414/820] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:24:26 2022] GET /compute/v2.1/os-volumes/e5715d95-3f05-4286-b1d4-360f11125585 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:24:29.949758 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:29.950535 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:29.954884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9df9f922-1112-4135-9d17-50e2f9ce92ec tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18b3e550>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:30.003594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9df9f922-1112-4135-9d17-50e2f9ce92ec tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/65052215-b6e3-46c8-a8b1-f109a0dae6c8" status: 200 len: 351 microversion: 2.1 time: 0.055159 May 26 18:24:30.004243 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 407/821] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:24:29 2022] GET /compute/v2.1/os-volumes/65052215-b6e3-46c8-a8b1-f109a0dae6c8 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:31.315971 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=5 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:31.317211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=11 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:31.322145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-15cefeee-053a-4a8b-bec0-279efabe046c tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f1846ae50>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:31.370403 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-15cefeee-053a-4a8b-bec0-279efabe046c tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/aeffb1c1-3ee4-4222-a080-cee9c9329baf" status: 200 len: 350 microversion: 2.1 time: 0.055422 May 26 18:24:31.370945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 415/822] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:24:31 2022] GET /compute/v2.1/os-volumes/aeffb1c1-3ee4-4222-a080-cee9c9329baf => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:32.686942 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7fa6b186-e94c-43be-9068-9533859f16a3 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18cdcd30>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:32.735750 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7fa6b186-e94c-43be-9068-9533859f16a3 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dc2e87f6-d4ad-4d24-bee4-5a44add5ef21" status: 200 len: 351 microversion: 2.1 time: 0.053602 May 26 18:24:32.736332 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 408/823] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 18:24:32 2022] GET /compute/v2.1/os-volumes/dc2e87f6-d4ad-4d24-bee4-5a44add5ef21 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:32.752573 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-cb349d9a-82f6-4bae-be39-1b53b49112e3 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18450e50>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:32.844329 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-cb349d9a-82f6-4bae-be39-1b53b49112e3 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100432 May 26 18:24:32.845082 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 416/824] 10.222.0.46 () {58 vars in 1133 bytes} [Thu May 26 18:24:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:32.857328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-14ec1374-5e8e-4601-be3e-7232c071cf59 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18b68820>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:32.945417 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-14ec1374-5e8e-4601-be3e-7232c071cf59 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091864 May 26 18:24:32.946317 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 409/825] 10.222.0.46 () {58 vars in 1148 bytes} [Thu May 26 18:24:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:32.958255 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8cc74095-679f-4539-86e5-d9970be47141 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f1856d040>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:33.040600 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8cc74095-679f-4539-86e5-d9970be47141 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086030 May 26 18:24:33.041162 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 417/826] 10.222.0.46 () {58 vars in 1133 bytes} [Thu May 26 18:24:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:33.052843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d572eec1-e163-40e7-9592-66c72f9acb4d tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18b32550>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:33.140373 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d572eec1-e163-40e7-9592-66c72f9acb4d tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091211 May 26 18:24:33.141451 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 410/827] 10.222.0.46 () {58 vars in 1166 bytes} [Thu May 26 18:24:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:24:33.156451 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7d919b0e-83e3-4560-9190-eb9137409333 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18559b80>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:33.246130 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7d919b0e-83e3-4560-9190-eb9137409333 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094457 May 26 18:24:33.246708 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 418/828] 10.222.0.46 () {58 vars in 1169 bytes} [Thu May 26 18:24:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:24:33.259470 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f66c2ce5-62ef-4f18-9182-8ac012af80b2 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18b3e310>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:33.355790 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f66c2ce5-62ef-4f18-9182-8ac012af80b2 tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100420 May 26 18:24:33.356620 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 411/829] 10.222.0.46 () {58 vars in 1154 bytes} [Thu May 26 18:24:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:33.368329 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d256ec72-8c5b-4aab-83ae-b9fe1a2779dc tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18559160>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:33.449225 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d256ec72-8c5b-4aab-83ae-b9fe1a2779dc tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084725 May 26 18:24:33.449828 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 419/830] 10.222.0.46 () {58 vars in 1187 bytes} [Thu May 26 18:24:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:33.461553 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ba48c203-fb94-437e-9765-d4532fdbcbad tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] Calling method '.version_select at 0x7f5f18c055e0>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:33.543884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ba48c203-fb94-437e-9765-d4532fdbcbad tempest-VolumesTestJSON-1229574557 tempest-VolumesTestJSON-1229574557-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086207 May 26 18:24:33.545503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 412/831] 10.222.0.46 () {58 vars in 1154 bytes} [Thu May 26 18:24:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:46.252770 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-75ff391f-7882-46d9-95f8-231fdaf4bd7f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:46.253687 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-75ff391f-7882-46d9-95f8-231fdaf4bd7f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:46.260430 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75ff391f-7882-46d9-95f8-231fdaf4bd7f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:46.260886 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75ff391f-7882-46d9-95f8-231fdaf4bd7f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:46.261657 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75ff391f-7882-46d9-95f8-231fdaf4bd7f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:46.262134 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75ff391f-7882-46d9-95f8-231fdaf4bd7f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:46.291879 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-75ff391f-7882-46d9-95f8-231fdaf4bd7f tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043730 May 26 18:24:46.292448 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 420/832] 10.222.0.46 () {60 vars in 1342 bytes} [Thu May 26 18:24:46 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:24:46.363036 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0bfd750b-c07b-4bb2-bd93-cfa85d0c2954 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:46.365809 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0bfd750b-c07b-4bb2-bd93-cfa85d0c2954 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:46.372442 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0bfd750b-c07b-4bb2-bd93-cfa85d0c2954 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:46.373266 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0bfd750b-c07b-4bb2-bd93-cfa85d0c2954 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:46.373665 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0bfd750b-c07b-4bb2-bd93-cfa85d0c2954 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:46.374166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0bfd750b-c07b-4bb2-bd93-cfa85d0c2954 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:46.400888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0bfd750b-c07b-4bb2-bd93-cfa85d0c2954 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:24:46.486577 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0bfd750b-c07b-4bb2-bd93-cfa85d0c2954 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "DELETE /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 204 len: 0 microversion: 2.20 time: 0.133608 May 26 18:24:46.487273 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 413/833] 10.222.0.46 () {60 vars in 1279 bytes} [Thu May 26 18:24:46 2022] DELETE /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:24:46.495437 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:46.496044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:46.502511 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:46.502958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:46.503717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:46.504169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:46.639212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:46.647270 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:46.648785 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:46.650131 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-765d3331-ddaf-48ce-9a25-3ae54648638c tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.158484 May 26 18:24:46.650692 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 421/834] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:46 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:24:47.668880 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:47.670506 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:47.677224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:47.677684 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:47.678493 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:47.678928 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:47.812859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:47.820777 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:47.822342 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:47.823497 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-452f3506-972e-4ba3-9ca1-04f71efbf4e8 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1719 microversion: 2.20 time: 0.158969 May 26 18:24:47.824051 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 414/835] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:47 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:48.844344 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:48.845555 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:48.853851 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:48.854496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:48.855426 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:48.856014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:48.907163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-c13971e3-1902-4bae-a166-865711f408b3 req-bd77b5f0-2ff8-4d46-8fc7-f0b787cf0a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f119e1-cd1f-4c56-bfed-f0d172ba0c8b", "name": "network-vif-deleted", "tag": "889d39d4-d8a9-413d-850d-667746898381"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:24:48.916953 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-c13971e3-1902-4bae-a166-865711f408b3 req-bd77b5f0-2ff8-4d46-8fc7-f0b787cf0a15 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:48.917706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-c13971e3-1902-4bae-a166-865711f408b3 req-bd77b5f0-2ff8-4d46-8fc7-f0b787cf0a15 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:48.940355 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-c13971e3-1902-4bae-a166-865711f408b3 req-bd77b5f0-2ff8-4d46-8fc7-f0b787cf0a15 service nova] Creating event network-vif-deleted:889d39d4-d8a9-413d-850d-667746898381 for instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b on hv-cinder-84349 May 26 18:24:48.947571 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-c13971e3-1902-4bae-a166-865711f408b3 req-bd77b5f0-2ff8-4d46-8fc7-f0b787cf0a15 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049062 May 26 18:24:48.955650 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:48.965322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 415/836] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:24:48.970511 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:48.972989 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2ffbc59c60455cb9cadda081e30381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dc70884aff4a799bb8f38899766e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:24:48.975153 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9bba0df9-0b39-4c59-92d6-20337ad87eed tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 200 len: 1652 microversion: 2.20 time: 0.135711 May 26 18:24:48.987913 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 422/837] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:48 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 1652 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:24:49.995893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:49.996596 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:50.004019 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:50.004478 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:50.005263 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:50.005700 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:50.019744 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] HTTP exception thrown: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Request method failure captured: May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b HTTP/1.1 May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8SWCyTrsAcHvjcPWXmgMr7CNljvR87yfbkUQhV1P8g1P3-p3NK9_ksuwNcdh9UM0MVmcOIkkUT5zp1MpiDYXg3w43qfLc9jhirBjRxqL5YDprnn4udU5pt37Az1-0onrFyeesRFE-rumsE8FMgMpFsjkaIeasrgORMt7pgODvW8st0 May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:50.021403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_84dc70884aff4a799bb8f38899766e81", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 7f2ffbc59c60455cb9cadda081e30381 May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:50.023222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '31f119e1-cd1f-4c56-bfed-f0d172ba0c8b'} May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:50.024337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:50.025624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:50.026790 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Returning 404 to user: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:50.026790 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-61ab72d9-f7a8-49e8-bde2-3b1f064ada24 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 404 len: 111 microversion: 2.20 time: 0.031739 May 26 18:24:50.026790 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 416/838] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:49 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:24:50.032817 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f6d64f5d-e109-45fa-a9cf-5e6bda807f6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '.version_select at 0x7f5f187ac790>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:50.052754 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f6d64f5d-e109-45fa-a9cf-5e6bda807f6d tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327814387" status: 204 len: 0 microversion: 2.20 time: 0.024265 May 26 18:24:50.053350 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 423/839] 10.222.0.46 () {60 vars in 1258 bytes} [Thu May 26 18:24:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327814387 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:24:51.816202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:51.816695 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:51.822905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:51.823362 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:51.824140 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:51.824583 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:51.839099 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] HTTP exception thrown: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Request method failure captured: May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: DELETE /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b HTTP/1.1 May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8SWCyTrsAcHvjcPWXmgMr7CNljvR87yfbkUQhV1P8g1P3-p3NK9_ksuwNcdh9UM0MVmcOIkkUT5zp1MpiDYXg3w43qfLc9jhirBjRxqL5YDprnn4udU5pt37Az1-0onrFyeesRFE-rumsE8FMgMpFsjkaIeasrgORMt7pgODvW8st0 May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:51.840711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_84dc70884aff4a799bb8f38899766e81", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 7f2ffbc59c60455cb9cadda081e30381 May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.842905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '31f119e1-cd1f-4c56-bfed-f0d172ba0c8b'} May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:51.843746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.844945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:51.846172 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Returning 404 to user: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:51.846172 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c7c6f5ad-b83d-4646-8021-e714c1c74919 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "DELETE /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 404 len: 111 microversion: 2.20 time: 0.031216 May 26 18:24:51.846172 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 417/840] 10.222.0.46 () {60 vars in 1279 bytes} [Thu May 26 18:24:51 2022] DELETE /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:24:51.851944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:51.852558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:51.861056 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:51.861507 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:51.862310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:51.862773 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:51.876697 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] HTTP exception thrown: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Request method failure captured: May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b HTTP/1.1 May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8SWCyTrsAcHvjcPWXmgMr7CNljvR87yfbkUQhV1P8g1P3-p3NK9_ksuwNcdh9UM0MVmcOIkkUT5zp1MpiDYXg3w43qfLc9jhirBjRxqL5YDprnn4udU5pt37Az1-0onrFyeesRFE-rumsE8FMgMpFsjkaIeasrgORMt7pgODvW8st0 May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:51.878440 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_84dc70884aff4a799bb8f38899766e81", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 7f2ffbc59c60455cb9cadda081e30381 May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.880135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '31f119e1-cd1f-4c56-bfed-f0d172ba0c8b'} May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:51.881012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. May 26 18:24:51.882503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:51.883790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Returning 404 to user: Instance 31f119e1-cd1f-4c56-bfed-f0d172ba0c8b could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:51.883790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-195e6e90-db7a-48c6-a7cf-98f6926d1c8b tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b" status: 404 len: 111 microversion: 2.20 time: 0.032237 May 26 18:24:51.883790 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 424/841] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:51 2022] GET /compute/v2.1/servers/31f119e1-cd1f-4c56-bfed-f0d172ba0c8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:24:53.021893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:53.022396 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:53.029429 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:53.029929 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:53.030706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:53.031151 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:53.045249 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] HTTP exception thrown: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Request method failure captured: May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: DELETE /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 HTTP/1.1 May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8SWCyTrsAcHvjcPWXmgMr7CNljvR87yfbkUQhV1P8g1P3-p3NK9_ksuwNcdh9UM0MVmcOIkkUT5zp1MpiDYXg3w43qfLc9jhirBjRxqL5YDprnn4udU5pt37Az1-0onrFyeesRFE-rumsE8FMgMpFsjkaIeasrgORMt7pgODvW8st0 May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:24:53.046827 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_84dc70884aff4a799bb8f38899766e81", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 7f2ffbc59c60455cb9cadda081e30381 May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.048439 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'aa0eeeed-f9b7-4526-bd2f-ac98a769fd80'} May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:53.049315 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.050778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:24:53.052503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Returning 404 to user: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:53.052503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-529c7db7-9238-48b0-9d2a-d2185658460a tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 404 len: 111 microversion: 2.20 time: 0.030243 May 26 18:24:53.052503 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 418/842] 10.222.0.46 () {60 vars in 1279 bytes} [Thu May 26 18:24:53 2022] DELETE /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:24:53.056818 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:24:53.057435 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] [instance: aa0eeeed-f9b7-4526-bd2f-ac98a769fd80] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:24:53.064320 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:53.064876 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:53.065814 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:24:53.066294 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:24:53.082304 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] HTTP exception thrown: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Request method failure captured: May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 HTTP/1.1 May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8SWCyTrsAcHvjcPWXmgMr7CNljvR87yfbkUQhV1P8g1P3-p3NK9_ksuwNcdh9UM0MVmcOIkkUT5zp1MpiDYXg3w43qfLc9jhirBjRxqL5YDprnn4udU5pt37Az1-0onrFyeesRFE-rumsE8FMgMpFsjkaIeasrgORMt7pgODvW8st0 May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:24:53.083837 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/84dc70884aff4a799bb8f38899766e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_84dc70884aff4a799bb8f38899766e81", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 84dc70884aff4a799bb8f38899766e81 May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1520129663 May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 7f2ffbc59c60455cb9cadda081e30381 May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1520129663-project May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.085461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'aa0eeeed-f9b7-4526-bd2f-ac98a769fd80'} May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:24:53.086549 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. May 26 18:24:53.087931 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:24:53.089237 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] Returning 404 to user: Instance aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:24:53.089237 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-22f22fbd-c869-49e1-bbac-e836e128dfc0 tempest-AttachVolumeShelveTestJSON-1520129663 tempest-AttachVolumeShelveTestJSON-1520129663-project] 10.222.0.46 "GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80" status: 404 len: 111 microversion: 2.20 time: 0.032258 May 26 18:24:53.089237 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 425/843] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 18:24:53 2022] GET /compute/v2.1/servers/aa0eeeed-f9b7-4526-bd2f-ac98a769fd80 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:25:00.766603 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-309737666", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "networks": [{"uuid": "13fd0d29-8c9c-4792-9360-d21719c2e330"}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:00.830623 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] validate_networks() for [('13fd0d29-8c9c-4792-9360-d21719c2e330', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:25:01.596761 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:25:01.597641 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:25:01.597641 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:25:01.598078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:25:01.598665 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:25:01.608485 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:01.608940 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:01.609769 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:01.610397 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:01.628609 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Getting quotas for project 77a61f18a22c4890b3f8ae6b327a1ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:25:01.632848 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Getting quotas for user bdcf4731b9944e79818294f38b17c5bb and project 77a61f18a22c4890b3f8ae6b327a1ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:25:01.646014 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:25:01.648358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:25:01.703785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a051facb-e039-4172-baba-9247b9b8d579 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941976 May 26 18:25:01.711704 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 419/844] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:25:01.720526 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5fa7194d-3d4a-4781-abd4-0f7686fb9849 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:01.722473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5fa7194d-3d4a-4781-abd4-0f7686fb9849 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:01.801211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5fa7194d-3d4a-4781-abd4-0f7686fb9849 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:01.809157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5fa7194d-3d4a-4781-abd4-0f7686fb9849 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1213 microversion: 2.1 time: 0.094928 May 26 18:25:01.810811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 426/845] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:01 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:02.829126 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-f003ab4f-085a-4f9f-8140-6e2d2bcf38cd tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:02.830533 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-f003ab4f-085a-4f9f-8140-6e2d2bcf38cd tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:02.839197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f003ab4f-085a-4f9f-8140-6e2d2bcf38cd tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:02.850234 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f003ab4f-085a-4f9f-8140-6e2d2bcf38cd tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:02.851319 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f003ab4f-085a-4f9f-8140-6e2d2bcf38cd tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:02.862784 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-f003ab4f-085a-4f9f-8140-6e2d2bcf38cd tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:02.987823 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-f003ab4f-085a-4f9f-8140-6e2d2bcf38cd tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:02.998959 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-f003ab4f-085a-4f9f-8140-6e2d2bcf38cd tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1283 microversion: 2.1 time: 0.174315 May 26 18:25:03.000387 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 420/846] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:02 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1283 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:04.016704 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-511eefc2-4cb5-44e0-a09d-310e492a6e46 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:04.018059 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-511eefc2-4cb5-44e0-a09d-310e492a6e46 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:04.020749 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=22 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:04.027269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-511eefc2-4cb5-44e0-a09d-310e492a6e46 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:04.029034 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-511eefc2-4cb5-44e0-a09d-310e492a6e46 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:04.030204 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-511eefc2-4cb5-44e0-a09d-310e492a6e46 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:04.030855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-511eefc2-4cb5-44e0-a09d-310e492a6e46 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:04.329012 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-511eefc2-4cb5-44e0-a09d-310e492a6e46 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:04.345376 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-511eefc2-4cb5-44e0-a09d-310e492a6e46 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1313 microversion: 2.1 time: 0.332778 May 26 18:25:04.346099 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 427/847] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:04 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:04.779940 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-442f7857-19ff-45d4-a4ac-7fb645071db7 req-5a711e25-d209-4973-9d75-e15388e9549c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a874ce78-ac36-4aea-a526-17f6d8b9e385", "tag": "cfc20dcc-9ac8-4c33-861d-0cbb14dfc40c"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:04.795652 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-442f7857-19ff-45d4-a4ac-7fb645071db7 req-5a711e25-d209-4973-9d75-e15388e9549c service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:04.796411 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-442f7857-19ff-45d4-a4ac-7fb645071db7 req-5a711e25-d209-4973-9d75-e15388e9549c service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:04.815324 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-442f7857-19ff-45d4-a4ac-7fb645071db7 req-5a711e25-d209-4973-9d75-e15388e9549c service nova] Creating event network-changed:cfc20dcc-9ac8-4c33-861d-0cbb14dfc40c for instance a874ce78-ac36-4aea-a526-17f6d8b9e385 on hv-cinder-84349 May 26 18:25:04.824161 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-442f7857-19ff-45d4-a4ac-7fb645071db7 req-5a711e25-d209-4973-9d75-e15388e9549c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051415 May 26 18:25:04.826258 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 421/848] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:25:05.367611 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-75cec828-ec24-4eb5-9bac-a61a651d9317 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:05.369005 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-75cec828-ec24-4eb5-9bac-a61a651d9317 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:05.381443 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75cec828-ec24-4eb5-9bac-a61a651d9317 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:05.382314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75cec828-ec24-4eb5-9bac-a61a651d9317 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:05.383739 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75cec828-ec24-4eb5-9bac-a61a651d9317 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:05.384539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75cec828-ec24-4eb5-9bac-a61a651d9317 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:05.590112 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-75cec828-ec24-4eb5-9bac-a61a651d9317 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:05.598530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-75cec828-ec24-4eb5-9bac-a61a651d9317 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1313 microversion: 2.1 time: 0.239093 May 26 18:25:05.599114 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 428/849] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:05 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:06.621372 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2348f18d-65f6-4b07-81f3-a9e77d5091ee tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:06.622465 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2348f18d-65f6-4b07-81f3-a9e77d5091ee tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:06.630958 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2348f18d-65f6-4b07-81f3-a9e77d5091ee tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:06.631739 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2348f18d-65f6-4b07-81f3-a9e77d5091ee tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:06.632876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2348f18d-65f6-4b07-81f3-a9e77d5091ee tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:06.633445 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2348f18d-65f6-4b07-81f3-a9e77d5091ee tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:06.804727 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2348f18d-65f6-4b07-81f3-a9e77d5091ee tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:06.814594 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2348f18d-65f6-4b07-81f3-a9e77d5091ee tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1313 microversion: 2.1 time: 0.200638 May 26 18:25:06.815499 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 422/850] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:06 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:07.833923 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f36cec3f-274f-4a3c-b712-612fb372bf8e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:07.834532 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f36cec3f-274f-4a3c-b712-612fb372bf8e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:07.841822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f36cec3f-274f-4a3c-b712-612fb372bf8e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:07.842280 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f36cec3f-274f-4a3c-b712-612fb372bf8e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:07.843105 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f36cec3f-274f-4a3c-b712-612fb372bf8e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:07.843546 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f36cec3f-274f-4a3c-b712-612fb372bf8e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:08.005986 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f36cec3f-274f-4a3c-b712-612fb372bf8e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:08.016472 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f36cec3f-274f-4a3c-b712-612fb372bf8e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1313 microversion: 2.1 time: 0.186742 May 26 18:25:08.017085 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 429/851] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:07 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:09.038386 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1eb4af2b-6ba5-4597-bcbe-0a212b834731 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:09.039389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1eb4af2b-6ba5-4597-bcbe-0a212b834731 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:09.046402 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1eb4af2b-6ba5-4597-bcbe-0a212b834731 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:09.046858 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1eb4af2b-6ba5-4597-bcbe-0a212b834731 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:09.047643 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1eb4af2b-6ba5-4597-bcbe-0a212b834731 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:09.048088 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1eb4af2b-6ba5-4597-bcbe-0a212b834731 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:09.194400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-1eb4af2b-6ba5-4597-bcbe-0a212b834731 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:09.203856 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1eb4af2b-6ba5-4597-bcbe-0a212b834731 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1313 microversion: 2.1 time: 0.169473 May 26 18:25:09.204437 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 423/852] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:09 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:09.381936 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-032125b0-559b-4a22-bf98-db0f15f04fb7 req-168b1f6a-3a0e-467a-9319-3ebedb2b94bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a874ce78-ac36-4aea-a526-17f6d8b9e385", "name": "network-vif-plugged", "status": "completed", "tag": "cfc20dcc-9ac8-4c33-861d-0cbb14dfc40c"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:09.391940 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-032125b0-559b-4a22-bf98-db0f15f04fb7 req-168b1f6a-3a0e-467a-9319-3ebedb2b94bb service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:09.392450 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-032125b0-559b-4a22-bf98-db0f15f04fb7 req-168b1f6a-3a0e-467a-9319-3ebedb2b94bb service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:09.405634 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-032125b0-559b-4a22-bf98-db0f15f04fb7 req-168b1f6a-3a0e-467a-9319-3ebedb2b94bb service nova] Creating event network-vif-plugged:cfc20dcc-9ac8-4c33-861d-0cbb14dfc40c for instance a874ce78-ac36-4aea-a526-17f6d8b9e385 on hv-cinder-84349 May 26 18:25:09.411070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-032125b0-559b-4a22-bf98-db0f15f04fb7 req-168b1f6a-3a0e-467a-9319-3ebedb2b94bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032835 May 26 18:25:09.411688 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 430/853] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:25:10.220646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-aaed4834-0b23-4ee6-9eff-bcbb6112de4b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:10.221257 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-aaed4834-0b23-4ee6-9eff-bcbb6112de4b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:10.228160 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-aaed4834-0b23-4ee6-9eff-bcbb6112de4b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:10.228658 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-aaed4834-0b23-4ee6-9eff-bcbb6112de4b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:10.229393 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-aaed4834-0b23-4ee6-9eff-bcbb6112de4b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:10.229876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-aaed4834-0b23-4ee6-9eff-bcbb6112de4b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:10.372473 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-aaed4834-0b23-4ee6-9eff-bcbb6112de4b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:10.383037 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-aaed4834-0b23-4ee6-9eff-bcbb6112de4b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1313 microversion: 2.1 time: 0.166098 May 26 18:25:10.384331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 424/854] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:10 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:11.401842 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d3c1b41e-3ff0-4aea-95b5-371edfe5e9c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:11.403346 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d3c1b41e-3ff0-4aea-95b5-371edfe5e9c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:11.410670 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d3c1b41e-3ff0-4aea-95b5-371edfe5e9c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:11.411219 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d3c1b41e-3ff0-4aea-95b5-371edfe5e9c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:11.412060 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d3c1b41e-3ff0-4aea-95b5-371edfe5e9c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:11.412680 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d3c1b41e-3ff0-4aea-95b5-371edfe5e9c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:11.569085 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d3c1b41e-3ff0-4aea-95b5-371edfe5e9c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:11.578566 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d3c1b41e-3ff0-4aea-95b5-371edfe5e9c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1313 microversion: 2.1 time: 0.181620 May 26 18:25:11.579280 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 431/855] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:11 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:25:12.597222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8cb183fe-9eaf-4f28-a2eb-f9d52fb14143 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:12.597866 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8cb183fe-9eaf-4f28-a2eb-f9d52fb14143 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:12.601512 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:12.602318 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=6 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:12.607535 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8cb183fe-9eaf-4f28-a2eb-f9d52fb14143 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:12.608033 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8cb183fe-9eaf-4f28-a2eb-f9d52fb14143 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:12.608915 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8cb183fe-9eaf-4f28-a2eb-f9d52fb14143 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:12.609366 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8cb183fe-9eaf-4f28-a2eb-f9d52fb14143 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:12.760694 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8cb183fe-9eaf-4f28-a2eb-f9d52fb14143 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:12.769452 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8cb183fe-9eaf-4f28-a2eb-f9d52fb14143 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1497 microversion: 2.1 time: 0.176474 May 26 18:25:12.770142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 425/856] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:12 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:13.188491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3af0f363-6739-46de-8fc7-3aa03f94e1a6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:13.189024 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3af0f363-6739-46de-8fc7-3aa03f94e1a6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:13.192122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:13.196905 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3af0f363-6739-46de-8fc7-3aa03f94e1a6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:13.197416 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3af0f363-6739-46de-8fc7-3aa03f94e1a6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:13.198234 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3af0f363-6739-46de-8fc7-3aa03f94e1a6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:13.198677 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3af0f363-6739-46de-8fc7-3aa03f94e1a6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:13.227490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3af0f363-6739-46de-8fc7-3aa03f94e1a6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:25:13.308652 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3af0f363-6739-46de-8fc7-3aa03f94e1a6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 204 len: 0 microversion: 2.1 time: 0.124712 May 26 18:25:13.310045 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 432/857] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:25:13 2022] DELETE /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:25:13.318617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c24ac24a-c7cd-4594-b3fd-859a73fa8d07 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:13.319238 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c24ac24a-c7cd-4594-b3fd-859a73fa8d07 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:13.325872 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c24ac24a-c7cd-4594-b3fd-859a73fa8d07 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:13.326333 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c24ac24a-c7cd-4594-b3fd-859a73fa8d07 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:13.327106 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c24ac24a-c7cd-4594-b3fd-859a73fa8d07 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:13.327550 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c24ac24a-c7cd-4594-b3fd-859a73fa8d07 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:13.460412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c24ac24a-c7cd-4594-b3fd-859a73fa8d07 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:13.468006 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c24ac24a-c7cd-4594-b3fd-859a73fa8d07 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1503 microversion: 2.1 time: 0.153294 May 26 18:25:13.468573 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 426/858] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:13 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:14.486458 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2f9b9693-3057-4159-bed1-eccde8b4b9e6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:14.487199 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2f9b9693-3057-4159-bed1-eccde8b4b9e6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:14.494044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f9b9693-3057-4159-bed1-eccde8b4b9e6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:14.494503 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f9b9693-3057-4159-bed1-eccde8b4b9e6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:14.495284 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f9b9693-3057-4159-bed1-eccde8b4b9e6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:14.495724 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2f9b9693-3057-4159-bed1-eccde8b4b9e6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:14.772317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2f9b9693-3057-4159-bed1-eccde8b4b9e6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:14.781172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2f9b9693-3057-4159-bed1-eccde8b4b9e6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 200 len: 1503 microversion: 2.1 time: 0.298841 May 26 18:25:14.782110 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 433/859] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:14 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 1503 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:15.170713 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-126ccaa2-71c3-4e9e-b5ed-f5e717a0688d req-be45faf4-d5f6-43c3-bd78-b5fa8678e721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a874ce78-ac36-4aea-a526-17f6d8b9e385", "name": "network-vif-deleted", "tag": "cfc20dcc-9ac8-4c33-861d-0cbb14dfc40c"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:15.184505 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-126ccaa2-71c3-4e9e-b5ed-f5e717a0688d req-be45faf4-d5f6-43c3-bd78-b5fa8678e721 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:15.184964 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-126ccaa2-71c3-4e9e-b5ed-f5e717a0688d req-be45faf4-d5f6-43c3-bd78-b5fa8678e721 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:15.197919 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-126ccaa2-71c3-4e9e-b5ed-f5e717a0688d req-be45faf4-d5f6-43c3-bd78-b5fa8678e721 service nova] Creating event network-vif-deleted:cfc20dcc-9ac8-4c33-861d-0cbb14dfc40c for instance a874ce78-ac36-4aea-a526-17f6d8b9e385 on hv-cinder-84349 May 26 18:25:15.204618 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-126ccaa2-71c3-4e9e-b5ed-f5e717a0688d req-be45faf4-d5f6-43c3-bd78-b5fa8678e721 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039239 May 26 18:25:15.205703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 427/860] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:25:15.798635 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:15.799343 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: a874ce78-ac36-4aea-a526-17f6d8b9e385] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:15.806159 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:15.806682 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:15.807516 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:15.808044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:15.822163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] HTTP exception thrown: Instance a874ce78-ac36-4aea-a526-17f6d8b9e385 could not be found. May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Request method failure captured: May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 HTTP/1.1 May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8X6XO85uoOJei0tnGoJSicIbm7qypiHfg8jFlncAG-9brJUiyQihwEhibGp-QyDBT7uqPcvbRXTN3hSo9k0ho3Nk6_WkZvUfIyEtFtuqcoCDU_u57bDwUOuT1K3R1_uyQvRm4G0k4K5b6toUl3urG4InlIT_eyPV_9M-fp1_CRhq8M May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 77a61f18a22c4890b3f8ae6b327a1ca5 May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesActionsTest-753617953 May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:25:15.823875 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/77a61f18a22c4890b3f8ae6b327a1ca5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/77a61f18a22c4890b3f8ae6b327a1ca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/77a61f18a22c4890b3f8ae6b327a1ca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_77a61f18a22c4890b3f8ae6b327a1ca5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesActionsTest-753617953 May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 77a61f18a22c4890b3f8ae6b327a1ca5 May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesActionsTest-753617953 May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesActionsTest-753617953-project May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: bdcf4731b9944e79818294f38b17c5bb May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesActionsTest-753617953-project May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance a874ce78-ac36-4aea-a526-17f6d8b9e385 could not be found. May 26 18:25:15.826406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'a874ce78-ac36-4aea-a526-17f6d8b9e385'} May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a874ce78-ac36-4aea-a526-17f6d8b9e385 could not be found. May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:25:15.827274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a874ce78-ac36-4aea-a526-17f6d8b9e385 could not be found. May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a874ce78-ac36-4aea-a526-17f6d8b9e385 could not be found. May 26 18:25:15.828797 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:25:15.830148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Returning 404 to user: Instance a874ce78-ac36-4aea-a526-17f6d8b9e385 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:25:15.830148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-28c6e243-822a-4fd9-bff0-415f18eff8c5 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385" status: 404 len: 111 microversion: 2.1 time: 0.031088 May 26 18:25:15.830148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 434/861] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:15 2022] GET /compute/v2.1/servers/a874ce78-ac36-4aea-a526-17f6d8b9e385 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:25:15.926471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1673049320", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "networks": [{"uuid": "13fd0d29-8c9c-4792-9360-d21719c2e330"}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:15.979781 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] validate_networks() for [('13fd0d29-8c9c-4792-9360-d21719c2e330', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:25:16.350792 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:25:16.351401 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:25:16.351761 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:25:16.352170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:25:16.352606 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:25:16.355290 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:16.365500 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:16.365981 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:16.366786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:16.367222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:16.374078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:16.388143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Getting quotas for project 77a61f18a22c4890b3f8ae6b327a1ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:25:16.392146 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Getting quotas for user bdcf4731b9944e79818294f38b17c5bb and project 77a61f18a22c4890b3f8ae6b327a1ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:25:16.403312 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:25:16.405626 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:25:16.456776 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6de009ec-b32f-4fbf-84c3-f6f7f759bd78 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534463 May 26 18:25:16.457813 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 428/862] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:25:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:25:16.468378 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-567b2518-70d5-485e-91bd-7d3e365a49c6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:16.469296 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-567b2518-70d5-485e-91bd-7d3e365a49c6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:16.471465 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:16.530044 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-567b2518-70d5-485e-91bd-7d3e365a49c6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:16.540601 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-567b2518-70d5-485e-91bd-7d3e365a49c6 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1214 microversion: 2.1 time: 0.076435 May 26 18:25:16.541466 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 435/863] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:16 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:25:17.558645 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-176659fd-6ef4-4fc1-baa6-4018a0fc8517 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:17.560580 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-176659fd-6ef4-4fc1-baa6-4018a0fc8517 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:17.566987 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-176659fd-6ef4-4fc1-baa6-4018a0fc8517 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:17.567440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-176659fd-6ef4-4fc1-baa6-4018a0fc8517 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:17.568209 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-176659fd-6ef4-4fc1-baa6-4018a0fc8517 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:17.568644 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-176659fd-6ef4-4fc1-baa6-4018a0fc8517 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:17.679015 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-176659fd-6ef4-4fc1-baa6-4018a0fc8517 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:17.687432 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-176659fd-6ef4-4fc1-baa6-4018a0fc8517 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1272 microversion: 2.1 time: 0.133127 May 26 18:25:17.697304 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 429/864] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:17 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:18.704793 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-dfd2b16f-dcaf-414a-ae35-b8b33a478a84 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:18.705417 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-dfd2b16f-dcaf-414a-ae35-b8b33a478a84 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:18.712648 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfd2b16f-dcaf-414a-ae35-b8b33a478a84 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:18.713108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfd2b16f-dcaf-414a-ae35-b8b33a478a84 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:18.713923 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfd2b16f-dcaf-414a-ae35-b8b33a478a84 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:18.714365 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-dfd2b16f-dcaf-414a-ae35-b8b33a478a84 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:19.159613 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-dfd2b16f-dcaf-414a-ae35-b8b33a478a84 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:19.167302 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-dfd2b16f-dcaf-414a-ae35-b8b33a478a84 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1314 microversion: 2.1 time: 0.466385 May 26 18:25:19.167884 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 436/865] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:18 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:25:19.283658 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-149ffb22-686d-43a4-8278-e753d33ce168 req-2b6d5a1f-8116-4a76-a34e-ecde43b62bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5dc8416-255d-4b55-8efe-91d85bb337f6", "tag": "fbcf4583-bea0-4d84-aada-9996c9db25d3"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:19.295408 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-149ffb22-686d-43a4-8278-e753d33ce168 req-2b6d5a1f-8116-4a76-a34e-ecde43b62bd2 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:19.296115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-149ffb22-686d-43a4-8278-e753d33ce168 req-2b6d5a1f-8116-4a76-a34e-ecde43b62bd2 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:19.311318 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-149ffb22-686d-43a4-8278-e753d33ce168 req-2b6d5a1f-8116-4a76-a34e-ecde43b62bd2 service nova] Creating event network-changed:fbcf4583-bea0-4d84-aada-9996c9db25d3 for instance e5dc8416-255d-4b55-8efe-91d85bb337f6 on hv-cinder-84349 May 26 18:25:19.316135 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-149ffb22-686d-43a4-8278-e753d33ce168 req-2b6d5a1f-8116-4a76-a34e-ecde43b62bd2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036607 May 26 18:25:19.316797 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 430/866] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:25:19.673506 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1016344621", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "networks": [{"uuid": "a24647b5-0762-44b0-83f9-073468e69da5"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:19.726319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] validate_networks() for [('a24647b5-0762-44b0-83f9-073468e69da5', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:25:20.077158 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:25:20.077586 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:25:20.078169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:25:20.078582 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:25:20.078997 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:25:20.087823 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:20.088277 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:20.089080 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:20.089522 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:20.107206 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Getting quotas for project 90546acc85c14828b2f1e0a906037a9c. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:25:20.111128 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Getting quotas for user 42f98b0f5afd497eb16ddd990dfcac26 and project 90546acc85c14828b2f1e0a906037a9c. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:25:20.122865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:25:20.125372 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:25:20.177182 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f9212ab0-2c5f-49e2-af3d-83df4c43650f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507609 May 26 18:25:20.179212 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 437/867] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:25:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:25:20.185243 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bc054221-47f9-4b28-85e3-00e23a0d9bf7 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:20.186210 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-bc054221-47f9-4b28-85e3-00e23a0d9bf7 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:20.189343 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e8840acc-f83f-4040-a61e-67f9d8444236 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:20.190243 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e8840acc-f83f-4040-a61e-67f9d8444236 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:20.193913 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc054221-47f9-4b28-85e3-00e23a0d9bf7 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:20.194626 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc054221-47f9-4b28-85e3-00e23a0d9bf7 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:20.195650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc054221-47f9-4b28-85e3-00e23a0d9bf7 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:20.196097 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bc054221-47f9-4b28-85e3-00e23a0d9bf7 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:20.249853 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e8840acc-f83f-4040-a61e-67f9d8444236 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:20.257362 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e8840acc-f83f-4040-a61e-67f9d8444236 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1219 microversion: 2.1 time: 0.072802 May 26 18:25:20.257983 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 438/868] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:20 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:20.386045 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bc054221-47f9-4b28-85e3-00e23a0d9bf7 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:20.395170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-bc054221-47f9-4b28-85e3-00e23a0d9bf7 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1314 microversion: 2.1 time: 0.214153 May 26 18:25:20.395762 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 431/869] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:20 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:21.275732 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-74e58fa1-7a8e-4e48-93ea-517d274a58a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:21.276950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-74e58fa1-7a8e-4e48-93ea-517d274a58a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:21.284088 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-74e58fa1-7a8e-4e48-93ea-517d274a58a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:21.284558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-74e58fa1-7a8e-4e48-93ea-517d274a58a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:21.285346 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-74e58fa1-7a8e-4e48-93ea-517d274a58a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:21.285820 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-74e58fa1-7a8e-4e48-93ea-517d274a58a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:21.366647 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-74e58fa1-7a8e-4e48-93ea-517d274a58a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:21.375321 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-74e58fa1-7a8e-4e48-93ea-517d274a58a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1277 microversion: 2.1 time: 0.103720 May 26 18:25:21.375908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 439/870] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:21 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:21.412587 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6df3db14-e97f-466f-91b0-14d99e50ac6e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:21.413438 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6df3db14-e97f-466f-91b0-14d99e50ac6e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:21.420193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6df3db14-e97f-466f-91b0-14d99e50ac6e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:21.420638 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6df3db14-e97f-466f-91b0-14d99e50ac6e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:21.421403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6df3db14-e97f-466f-91b0-14d99e50ac6e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:21.421862 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6df3db14-e97f-466f-91b0-14d99e50ac6e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:21.624382 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6df3db14-e97f-466f-91b0-14d99e50ac6e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:21.631839 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6df3db14-e97f-466f-91b0-14d99e50ac6e tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1314 microversion: 2.1 time: 0.223284 May 26 18:25:21.632403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 432/871] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:21 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:25:22.393229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c8bcefc4-137b-440c-aa0a-d83209acbea9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:22.393884 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c8bcefc4-137b-440c-aa0a-d83209acbea9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:22.400546 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8bcefc4-137b-440c-aa0a-d83209acbea9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:22.401038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8bcefc4-137b-440c-aa0a-d83209acbea9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:22.401935 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8bcefc4-137b-440c-aa0a-d83209acbea9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:22.402378 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8bcefc4-137b-440c-aa0a-d83209acbea9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:22.596221 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-6c3f3317-ab8e-430f-b661-8e53113907f6 req-97678ab5-0da7-4f6a-8df7-86da543f92e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d07208-f4f4-41e4-9387-8feeba4abf81", "tag": "6440f051-628f-4838-97b5-c2eebfd47861"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:22.606320 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-6c3f3317-ab8e-430f-b661-8e53113907f6 req-97678ab5-0da7-4f6a-8df7-86da543f92e9 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:22.606847 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-6c3f3317-ab8e-430f-b661-8e53113907f6 req-97678ab5-0da7-4f6a-8df7-86da543f92e9 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:22.616909 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c8bcefc4-137b-440c-aa0a-d83209acbea9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:22.620421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-6c3f3317-ab8e-430f-b661-8e53113907f6 req-97678ab5-0da7-4f6a-8df7-86da543f92e9 service nova] Creating event network-changed:6440f051-628f-4838-97b5-c2eebfd47861 for instance 53d07208-f4f4-41e4-9387-8feeba4abf81 on hv-cinder-84349 May 26 18:25:22.625798 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-6c3f3317-ab8e-430f-b661-8e53113907f6 req-97678ab5-0da7-4f6a-8df7-86da543f92e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035824 May 26 18:25:22.627813 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 433/872] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:25:22.631358 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c8bcefc4-137b-440c-aa0a-d83209acbea9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1319 microversion: 2.1 time: 0.241998 May 26 18:25:22.632025 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 440/873] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:22 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:22.648853 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a4c0ff0d-a19b-486e-8c4c-cadc14872fc8 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:22.649564 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a4c0ff0d-a19b-486e-8c4c-cadc14872fc8 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:22.658027 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff0d-a19b-486e-8c4c-cadc14872fc8 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:22.658477 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff0d-a19b-486e-8c4c-cadc14872fc8 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:22.659556 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff0d-a19b-486e-8c4c-cadc14872fc8 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:22.660009 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff0d-a19b-486e-8c4c-cadc14872fc8 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:22.869098 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a4c0ff0d-a19b-486e-8c4c-cadc14872fc8 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:22.878046 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a4c0ff0d-a19b-486e-8c4c-cadc14872fc8 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1314 microversion: 2.1 time: 0.233308 May 26 18:25:22.878637 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 434/874] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:22 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:23.227000 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-58bf3e8a-aba0-43d8-b37d-3394c11f1ad3 req-35389960-5410-4343-962f-bc918975db37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5dc8416-255d-4b55-8efe-91d85bb337f6", "name": "network-vif-plugged", "status": "completed", "tag": "fbcf4583-bea0-4d84-aada-9996c9db25d3"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:23.236319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-58bf3e8a-aba0-43d8-b37d-3394c11f1ad3 req-35389960-5410-4343-962f-bc918975db37 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:23.236891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-58bf3e8a-aba0-43d8-b37d-3394c11f1ad3 req-35389960-5410-4343-962f-bc918975db37 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:23.252074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-58bf3e8a-aba0-43d8-b37d-3394c11f1ad3 req-35389960-5410-4343-962f-bc918975db37 service nova] Creating event network-vif-plugged:fbcf4583-bea0-4d84-aada-9996c9db25d3 for instance e5dc8416-255d-4b55-8efe-91d85bb337f6 on hv-cinder-84349 May 26 18:25:23.257171 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-58bf3e8a-aba0-43d8-b37d-3394c11f1ad3 req-35389960-5410-4343-962f-bc918975db37 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033967 May 26 18:25:23.257798 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 441/875] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:25:23.648900 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-19e49abb-7a8b-4aef-bc73-66a144803db1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:23.649513 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-19e49abb-7a8b-4aef-bc73-66a144803db1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:23.657242 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-19e49abb-7a8b-4aef-bc73-66a144803db1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:23.657687 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-19e49abb-7a8b-4aef-bc73-66a144803db1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:23.658537 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-19e49abb-7a8b-4aef-bc73-66a144803db1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:23.658984 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-19e49abb-7a8b-4aef-bc73-66a144803db1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:23.896991 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c14ab99b-95b0-47a3-9ad3-ef5cb8746ebb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:23.897699 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c14ab99b-95b0-47a3-9ad3-ef5cb8746ebb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:23.906208 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c14ab99b-95b0-47a3-9ad3-ef5cb8746ebb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:23.906581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c14ab99b-95b0-47a3-9ad3-ef5cb8746ebb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:23.907581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c14ab99b-95b0-47a3-9ad3-ef5cb8746ebb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:23.908029 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c14ab99b-95b0-47a3-9ad3-ef5cb8746ebb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:23.909376 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-19e49abb-7a8b-4aef-bc73-66a144803db1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:23.918469 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-19e49abb-7a8b-4aef-bc73-66a144803db1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1319 microversion: 2.1 time: 0.273210 May 26 18:25:23.919088 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 435/876] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:23 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:24.115147 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c14ab99b-95b0-47a3-9ad3-ef5cb8746ebb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:24.123169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c14ab99b-95b0-47a3-9ad3-ef5cb8746ebb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1314 microversion: 2.1 time: 0.230482 May 26 18:25:24.123759 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 442/877] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:23 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:24.935857 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d1300932-605e-4917-b042-75bc1b523614 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:24.936470 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d1300932-605e-4917-b042-75bc1b523614 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:24.942876 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d1300932-605e-4917-b042-75bc1b523614 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:24.943321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d1300932-605e-4917-b042-75bc1b523614 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:24.944084 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d1300932-605e-4917-b042-75bc1b523614 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:24.944512 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d1300932-605e-4917-b042-75bc1b523614 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:25.073805 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d1300932-605e-4917-b042-75bc1b523614 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:25.081661 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d1300932-605e-4917-b042-75bc1b523614 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1319 microversion: 2.1 time: 0.149920 May 26 18:25:25.082262 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 436/878] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:24 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:25.140303 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1e6ce3b6-2bf5-491c-b64b-26b8748cf728 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:25.140921 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1e6ce3b6-2bf5-491c-b64b-26b8748cf728 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:25.147603 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1e6ce3b6-2bf5-491c-b64b-26b8748cf728 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:25.148055 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1e6ce3b6-2bf5-491c-b64b-26b8748cf728 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:25.148827 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1e6ce3b6-2bf5-491c-b64b-26b8748cf728 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:25.149270 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1e6ce3b6-2bf5-491c-b64b-26b8748cf728 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:25.285011 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1e6ce3b6-2bf5-491c-b64b-26b8748cf728 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:25.292691 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1e6ce3b6-2bf5-491c-b64b-26b8748cf728 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1314 microversion: 2.1 time: 0.156209 May 26 18:25:25.294399 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 443/879] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:25 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:26.099080 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0a868151-1bc1-4aa7-8e35-1f6bb621152f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:26.099703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0a868151-1bc1-4aa7-8e35-1f6bb621152f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:26.106963 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a868151-1bc1-4aa7-8e35-1f6bb621152f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:26.107418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a868151-1bc1-4aa7-8e35-1f6bb621152f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:26.108191 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a868151-1bc1-4aa7-8e35-1f6bb621152f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:26.108632 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0a868151-1bc1-4aa7-8e35-1f6bb621152f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:26.238976 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0a868151-1bc1-4aa7-8e35-1f6bb621152f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:26.247187 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0a868151-1bc1-4aa7-8e35-1f6bb621152f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1319 microversion: 2.1 time: 0.151182 May 26 18:25:26.248013 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 437/880] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:26 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:26.312064 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-36eb044d-79c8-4786-9b15-c82f15989766 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:26.312865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-36eb044d-79c8-4786-9b15-c82f15989766 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:26.320779 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-36eb044d-79c8-4786-9b15-c82f15989766 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:26.321233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-36eb044d-79c8-4786-9b15-c82f15989766 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:26.322135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-36eb044d-79c8-4786-9b15-c82f15989766 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:26.322940 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-36eb044d-79c8-4786-9b15-c82f15989766 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:26.466707 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-36eb044d-79c8-4786-9b15-c82f15989766 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:26.474104 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-36eb044d-79c8-4786-9b15-c82f15989766 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1498 microversion: 2.1 time: 0.166342 May 26 18:25:26.474673 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 444/881] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:26 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:26.902446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1e93e4f5-0c8c-453c-8a0a-992a55476f96 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:26.903043 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1e93e4f5-0c8c-453c-8a0a-992a55476f96 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:26.904944 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:26.905611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=6 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:26.911412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1e93e4f5-0c8c-453c-8a0a-992a55476f96 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:26.911868 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1e93e4f5-0c8c-453c-8a0a-992a55476f96 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:26.912649 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1e93e4f5-0c8c-453c-8a0a-992a55476f96 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:26.913090 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1e93e4f5-0c8c-453c-8a0a-992a55476f96 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:26.942829 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1e93e4f5-0c8c-453c-8a0a-992a55476f96 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:25:27.026822 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1e93e4f5-0c8c-453c-8a0a-992a55476f96 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 204 len: 0 microversion: 2.1 time: 0.127947 May 26 18:25:27.027545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 438/882] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:25:26 2022] DELETE /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:25:27.037485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-5db54922-2d82-48ad-9da9-cc457e7d9b5b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:27.038147 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-5db54922-2d82-48ad-9da9-cc457e7d9b5b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:27.045417 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5db54922-2d82-48ad-9da9-cc457e7d9b5b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:27.045900 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5db54922-2d82-48ad-9da9-cc457e7d9b5b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:27.046679 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5db54922-2d82-48ad-9da9-cc457e7d9b5b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:27.047116 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-5db54922-2d82-48ad-9da9-cc457e7d9b5b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:27.182840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-5db54922-2d82-48ad-9da9-cc457e7d9b5b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:27.190671 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-5db54922-2d82-48ad-9da9-cc457e7d9b5b tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1504 microversion: 2.1 time: 0.157165 May 26 18:25:27.191261 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 445/883] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:27 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:27.265260 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ab5aeeda-334e-431c-82a7-6c8cf01ce117 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:27.266098 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ab5aeeda-334e-431c-82a7-6c8cf01ce117 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:27.270248 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-aae26e0b-e23a-4cf0-936c-e203f98ce20b req-76a01c25-4627-4766-be2b-e598efefd827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d07208-f4f4-41e4-9387-8feeba4abf81", "name": "network-vif-plugged", "status": "completed", "tag": "6440f051-628f-4838-97b5-c2eebfd47861"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:27.272534 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ab5aeeda-334e-431c-82a7-6c8cf01ce117 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:27.272992 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ab5aeeda-334e-431c-82a7-6c8cf01ce117 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:27.273948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ab5aeeda-334e-431c-82a7-6c8cf01ce117 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:27.274466 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ab5aeeda-334e-431c-82a7-6c8cf01ce117 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:27.279930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-aae26e0b-e23a-4cf0-936c-e203f98ce20b req-76a01c25-4627-4766-be2b-e598efefd827 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:27.280377 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-aae26e0b-e23a-4cf0-936c-e203f98ce20b req-76a01c25-4627-4766-be2b-e598efefd827 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:27.295326 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-aae26e0b-e23a-4cf0-936c-e203f98ce20b req-76a01c25-4627-4766-be2b-e598efefd827 service nova] Creating event network-vif-plugged:6440f051-628f-4838-97b5-c2eebfd47861 for instance 53d07208-f4f4-41e4-9387-8feeba4abf81 on hv-cinder-84349 May 26 18:25:27.300707 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-aae26e0b-e23a-4cf0-936c-e203f98ce20b req-76a01c25-4627-4766-be2b-e598efefd827 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034326 May 26 18:25:27.301477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 446/884] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:25:27.452442 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ab5aeeda-334e-431c-82a7-6c8cf01ce117 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:27.460018 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ab5aeeda-334e-431c-82a7-6c8cf01ce117 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1319 microversion: 2.1 time: 0.199724 May 26 18:25:27.460584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 439/885] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:27 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:28.207926 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8f8d1d9d-8eef-409b-950a-ebce20462804 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:28.208927 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8f8d1d9d-8eef-409b-950a-ebce20462804 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:28.216796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f8d1d9d-8eef-409b-950a-ebce20462804 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:28.216796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f8d1d9d-8eef-409b-950a-ebce20462804 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:28.217586 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f8d1d9d-8eef-409b-950a-ebce20462804 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:28.218088 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8f8d1d9d-8eef-409b-950a-ebce20462804 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:28.222741 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:28.477557 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-97928d7c-4931-4a91-9ce0-a74f8fac47bc tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:28.478230 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-97928d7c-4931-4a91-9ce0-a74f8fac47bc tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:28.486000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97928d7c-4931-4a91-9ce0-a74f8fac47bc tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:28.486451 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97928d7c-4931-4a91-9ce0-a74f8fac47bc tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:28.487221 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97928d7c-4931-4a91-9ce0-a74f8fac47bc tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:28.487650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97928d7c-4931-4a91-9ce0-a74f8fac47bc tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:28.720205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8f8d1d9d-8eef-409b-950a-ebce20462804 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:28.727680 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8f8d1d9d-8eef-409b-950a-ebce20462804 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1504 microversion: 2.1 time: 0.524080 May 26 18:25:28.728276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 447/886] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:28 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:28.749283 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-97928d7c-4931-4a91-9ce0-a74f8fac47bc tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:28.756729 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-97928d7c-4931-4a91-9ce0-a74f8fac47bc tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1319 microversion: 2.1 time: 0.283086 May 26 18:25:28.757310 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 440/887] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:28 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:25:29.188340 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-daccb7f3-71df-4e24-a849-b8f26cfcf63a req-1261a5f1-7815-4e8b-acb8-7f471a8e090b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5dc8416-255d-4b55-8efe-91d85bb337f6", "name": "network-vif-deleted", "tag": "fbcf4583-bea0-4d84-aada-9996c9db25d3"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:29.198985 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-daccb7f3-71df-4e24-a849-b8f26cfcf63a req-1261a5f1-7815-4e8b-acb8-7f471a8e090b service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:29.199925 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-daccb7f3-71df-4e24-a849-b8f26cfcf63a req-1261a5f1-7815-4e8b-acb8-7f471a8e090b service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:29.212750 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-daccb7f3-71df-4e24-a849-b8f26cfcf63a req-1261a5f1-7815-4e8b-acb8-7f471a8e090b service nova] Creating event network-vif-deleted:fbcf4583-bea0-4d84-aada-9996c9db25d3 for instance e5dc8416-255d-4b55-8efe-91d85bb337f6 on hv-cinder-84349 May 26 18:25:29.218226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-daccb7f3-71df-4e24-a849-b8f26cfcf63a req-1261a5f1-7815-4e8b-acb8-7f471a8e090b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033857 May 26 18:25:29.218829 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 448/888] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:25:29.749479 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:29.750493 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:29.757851 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:29.758340 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:29.759141 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:29.759804 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:29.774544 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-39f56e25-d2ab-4fc1-8247-c37694425490 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:29.775241 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-39f56e25-d2ab-4fc1-8247-c37694425490 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:29.781640 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-39f56e25-d2ab-4fc1-8247-c37694425490 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:29.782139 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-39f56e25-d2ab-4fc1-8247-c37694425490 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:29.782910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-39f56e25-d2ab-4fc1-8247-c37694425490 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:29.783346 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-39f56e25-d2ab-4fc1-8247-c37694425490 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:29.791992 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:29.792441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:29.792891 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lazy-loading 'fault' on Instance uuid e5dc8416-255d-4b55-8efe-91d85bb337f6 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:25:29.836553 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf4731b9944e79818294f38b17c5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a61f18a22c4890b3f8ae6b327a1ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:29.844364 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7c157fcb-3f78-49bd-baaf-061abfa9ec68 tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 200 len: 1304 microversion: 2.1 time: 0.101197 May 26 18:25:29.844950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 441/889] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:29 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:25:29.932865 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-39f56e25-d2ab-4fc1-8247-c37694425490 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:25:29.941098 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-39f56e25-d2ab-4fc1-8247-c37694425490 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1509 microversion: 2.1 time: 0.170786 May 26 18:25:29.941664 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 449/890] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:29 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:25:30.861630 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:25:30.862272 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] [instance: e5dc8416-255d-4b55-8efe-91d85bb337f6] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:30.868792 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:30.869276 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:30.870073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:30.870508 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:30.883921 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] HTTP exception thrown: Instance e5dc8416-255d-4b55-8efe-91d85bb337f6 could not be found. May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Request method failure captured: May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 HTTP/1.1 May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8X6XO85uoOJei0tnGoJSicIbm7qypiHfg8jFlncAG-9brJUiyQihwEhibGp-QyDBT7uqPcvbRXTN3hSo9k0ho3Nk6_WkZvUfIyEtFtuqcoCDU_u57bDwUOuT1K3R1_uyQvRm4G0k4K5b6toUl3urG4InlIT_eyPV_9M-fp1_CRhq8M May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 77a61f18a22c4890b3f8ae6b327a1ca5 May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-VolumesActionsTest-753617953 May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:25:30.885578 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/77a61f18a22c4890b3f8ae6b327a1ca5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/77a61f18a22c4890b3f8ae6b327a1ca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/77a61f18a22c4890b3f8ae6b327a1ca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_77a61f18a22c4890b3f8ae6b327a1ca5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-VolumesActionsTest-753617953 May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 77a61f18a22c4890b3f8ae6b327a1ca5 May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-VolumesActionsTest-753617953 May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-VolumesActionsTest-753617953-project May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: bdcf4731b9944e79818294f38b17c5bb May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-VolumesActionsTest-753617953-project May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance e5dc8416-255d-4b55-8efe-91d85bb337f6 could not be found. May 26 18:25:30.887834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'e5dc8416-255d-4b55-8efe-91d85bb337f6'} May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5dc8416-255d-4b55-8efe-91d85bb337f6 could not be found. May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:25:30.888905 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5dc8416-255d-4b55-8efe-91d85bb337f6 could not be found. May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5dc8416-255d-4b55-8efe-91d85bb337f6 could not be found. May 26 18:25:30.890519 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:25:30.892119 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] Returning 404 to user: Instance e5dc8416-255d-4b55-8efe-91d85bb337f6 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:25:30.892119 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-5266b047-3da3-4329-9f34-2f05d7295bcb tempest-VolumesActionsTest-753617953 tempest-VolumesActionsTest-753617953-project] 10.222.0.46 "GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6" status: 404 len: 111 microversion: 2.1 time: 0.029415 May 26 18:25:30.892119 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 442/891] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:25:30 2022] GET /compute/v2.1/servers/e5dc8416-255d-4b55-8efe-91d85bb337f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:25:48.461003 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7fcd4b60-961b-45ae-bc50-52af3484efcf tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70deb215-a9d1-46b9-b757-f5bbbaeedcd7", "device": "/dev/sdb"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:25:48.462750 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7fcd4b60-961b-45ae-bc50-52af3484efcf tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:25:48.466718 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:48.467905 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=10 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:48.468799 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:48.469606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=12 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:48.474297 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7fcd4b60-961b-45ae-bc50-52af3484efcf tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:48.477468 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7fcd4b60-961b-45ae-bc50-52af3484efcf tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:48.480013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7fcd4b60-961b-45ae-bc50-52af3484efcf tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:25:48.481346 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7fcd4b60-961b-45ae-bc50-52af3484efcf tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:25:48.910136 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7fcd4b60-961b-45ae-bc50-52af3484efcf tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "POST /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454865 May 26 18:25:48.914106 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 450/892] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:25:48 2022] POST /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:06.120772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:06.121510 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:06.297319 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1ba1f41d-2be1-4000-b660-338f116d0886 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Action: 'create', calling method: .version_select at 0x7f5f18d2edc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1204774411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRoyPrz8B31ty67QAPU6ggxo5k3PuPXsa63Vau5PqhFsFaZjWMX2LegoRrLAMCKM8pWeMshYETzMU/l2hYKpWYPGnQ+UvEgc5+2czHzj4cEJYY/EQ60O8EZHEa6UHXZuQ=="}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:06.312527 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-1ba1f41d-2be1-4000-b660-338f116d0886 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Getting quotas for project 564690a570ea4ec199dc599d288756b0. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:26:06.316697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-1ba1f41d-2be1-4000-b660-338f116d0886 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Getting quotas for user 73559b7886614dd2a92e9c6c53307331 and project 564690a570ea4ec199dc599d288756b0. Resources: {'key_pairs'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:26:06.342838 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1ba1f41d-2be1-4000-b660-338f116d0886 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.227499 May 26 18:26:06.349467 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 443/893] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:26:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:08.902177 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e00ec652-f184-4467-8fbd-4c250b7109b1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:08.902755 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e00ec652-f184-4467-8fbd-4c250b7109b1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:08.905255 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:08.906114 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:08.912469 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e00ec652-f184-4467-8fbd-4c250b7109b1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:08.912919 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e00ec652-f184-4467-8fbd-4c250b7109b1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:08.913681 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e00ec652-f184-4467-8fbd-4c250b7109b1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:08.914151 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e00ec652-f184-4467-8fbd-4c250b7109b1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:09.014995 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-e00ec652-f184-4467-8fbd-4c250b7109b1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lazy-loading 'services' on Instance uuid 53d07208-f4f4-41e4-9387-8feeba4abf81 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:26:09.091973 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e00ec652-f184-4467-8fbd-4c250b7109b1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81/os-volume_attachments/70deb215-a9d1-46b9-b757-f5bbbaeedcd7" status: 202 len: 0 microversion: 2.1 time: 0.193568 May 26 18:26:09.092252 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 451/894] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:26:08 2022] DELETE /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81/os-volume_attachments/70deb215-a9d1-46b9-b757-f5bbbaeedcd7 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:26:10.235059 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-58622b5f-d576-49e4-89af-c15821ab34aa tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:10.235681 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-58622b5f-d576-49e4-89af-c15821ab34aa tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:10.242343 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-58622b5f-d576-49e4-89af-c15821ab34aa tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:10.242861 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-58622b5f-d576-49e4-89af-c15821ab34aa tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:10.243716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-58622b5f-d576-49e4-89af-c15821ab34aa tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:10.244215 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-58622b5f-d576-49e4-89af-c15821ab34aa tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:10.273333 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-58622b5f-d576-49e4-89af-c15821ab34aa tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:26:10.391010 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-58622b5f-d576-49e4-89af-c15821ab34aa tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 204 len: 0 microversion: 2.1 time: 0.161612 May 26 18:26:10.395755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 444/895] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:26:10 2022] DELETE /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:26:10.401148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a41a4833-cf1a-4dac-801b-945d21d9b805 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:10.402054 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a41a4833-cf1a-4dac-801b-945d21d9b805 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:10.412569 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a41a4833-cf1a-4dac-801b-945d21d9b805 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:10.413410 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a41a4833-cf1a-4dac-801b-945d21d9b805 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:10.414226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a41a4833-cf1a-4dac-801b-945d21d9b805 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:10.414660 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a41a4833-cf1a-4dac-801b-945d21d9b805 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:10.566179 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a41a4833-cf1a-4dac-801b-945d21d9b805 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:10.576481 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a41a4833-cf1a-4dac-801b-945d21d9b805 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1515 microversion: 2.1 time: 0.180063 May 26 18:26:10.577494 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 452/896] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:10 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:26:11.594750 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e88fde3e-5af1-4144-b8bc-e975f91c143e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:11.595366 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e88fde3e-5af1-4144-b8bc-e975f91c143e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:11.602173 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e88fde3e-5af1-4144-b8bc-e975f91c143e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:11.602635 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e88fde3e-5af1-4144-b8bc-e975f91c143e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:11.603429 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e88fde3e-5af1-4144-b8bc-e975f91c143e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:11.603875 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e88fde3e-5af1-4144-b8bc-e975f91c143e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:11.740192 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e88fde3e-5af1-4144-b8bc-e975f91c143e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:11.748828 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e88fde3e-5af1-4144-b8bc-e975f91c143e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1515 microversion: 2.1 time: 0.158480 May 26 18:26:11.749407 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 445/897] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:11 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:12.598707 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-805b8614-7d46-41b3-8604-82df88d38f1b req-1f8e2027-4b13-4c29-8ebf-36ddc58819d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d07208-f4f4-41e4-9387-8feeba4abf81", "name": "network-vif-deleted", "tag": "6440f051-628f-4838-97b5-c2eebfd47861"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:12.608754 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-805b8614-7d46-41b3-8604-82df88d38f1b req-1f8e2027-4b13-4c29-8ebf-36ddc58819d4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:12.609203 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-805b8614-7d46-41b3-8604-82df88d38f1b req-1f8e2027-4b13-4c29-8ebf-36ddc58819d4 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:12.622126 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-805b8614-7d46-41b3-8604-82df88d38f1b req-1f8e2027-4b13-4c29-8ebf-36ddc58819d4 service nova] Creating event network-vif-deleted:6440f051-628f-4838-97b5-c2eebfd47861 for instance 53d07208-f4f4-41e4-9387-8feeba4abf81 on hv-cinder-84349 May 26 18:26:12.628113 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-805b8614-7d46-41b3-8604-82df88d38f1b req-1f8e2027-4b13-4c29-8ebf-36ddc58819d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032987 May 26 18:26:12.629108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 453/898] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:12.766410 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:12.767024 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:12.773703 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:12.774175 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:12.774933 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:12.775360 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:12.809137 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:12.809504 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:12.810092 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lazy-loading 'fault' on Instance uuid 53d07208-f4f4-41e4-9387-8feeba4abf81 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:26:12.851679 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:12.859838 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6e3b9c90-fbf4-4817-b911-c85e200b5fd2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 200 len: 1309 microversion: 2.1 time: 0.097531 May 26 18:26:12.860605 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 446/899] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:12 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:13.877646 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:13.878389 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 53d07208-f4f4-41e4-9387-8feeba4abf81] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:13.884696 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:13.885154 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:13.886360 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:13.886811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:13.901208 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] HTTP exception thrown: Instance 53d07208-f4f4-41e4-9387-8feeba4abf81 could not be found. May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Request method failure captured: May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 HTTP/1.1 May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8YOfM7UNikPv9doTzmKBoYBHg_8-RS9FXf1ZVz0E5Z5mE_S7C8PaijVe5GNBuE8RBqapMA-c6uDq5C5IDM8n4RuaS0lZMC-unsmHagLsmWQHY-94w0jD-pGw1I6mKwg-WWZIbpAIYmDgcKMdej4fiZUqEFmA-YVOoqLlNCOsLbZm_o May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 90546acc85c14828b2f1e0a906037a9c May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1240623288 May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:26:13.903368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/90546acc85c14828b2f1e0a906037a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/90546acc85c14828b2f1e0a906037a9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/90546acc85c14828b2f1e0a906037a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_90546acc85c14828b2f1e0a906037a9c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-VolumesSnapshotTestJSON-1240623288 May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 90546acc85c14828b2f1e0a906037a9c May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1240623288 May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-VolumesSnapshotTestJSON-1240623288-project May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 42f98b0f5afd497eb16ddd990dfcac26 May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-VolumesSnapshotTestJSON-1240623288-project May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance 53d07208-f4f4-41e4-9387-8feeba4abf81 could not be found. May 26 18:26:13.905057 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': '53d07208-f4f4-41e4-9387-8feeba4abf81'} May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d07208-f4f4-41e4-9387-8feeba4abf81 could not be found. May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:26:13.905980 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d07208-f4f4-41e4-9387-8feeba4abf81 could not be found. May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d07208-f4f4-41e4-9387-8feeba4abf81 could not be found. May 26 18:26:13.907314 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:26:13.908473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Returning 404 to user: Instance 53d07208-f4f4-41e4-9387-8feeba4abf81 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:26:13.908473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4d0b1876-1a78-4a70-8f6d-ca0ecca8dd2f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81" status: 404 len: 111 microversion: 2.1 time: 0.031995 May 26 18:26:13.908473 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 454/900] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:13 2022] GET /compute/v2.1/servers/53d07208-f4f4-41e4-9387-8feeba4abf81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:26:22.964308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1497612446", "imageRef": "8fca9824-b356-4da0-8f8b-8cee3522fcea", "flavorRef": "452", "networks": [{"uuid": "a24647b5-0762-44b0-83f9-073468e69da5"}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:22.971452 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=4 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:22.972267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:22.972819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:23.027035 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] validate_networks() for [('a24647b5-0762-44b0-83f9-073468e69da5', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:26:23.383859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:26:23.384297 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:26:23.384769 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:26:23.385655 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:26:23.386113 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:26:23.394998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:23.395446 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:23.396240 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:23.396676 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:23.414270 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Getting quotas for project 90546acc85c14828b2f1e0a906037a9c. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:26:23.418326 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Getting quotas for user 42f98b0f5afd497eb16ddd990dfcac26 and project 90546acc85c14828b2f1e0a906037a9c. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:26:23.429363 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:26:23.431622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fca9824-b356-4da0-8f8b-8cee3522fcea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:26:23.476224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-1cdb4005-1b4e-429b-bc5c-89cc95cdf41e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516463 May 26 18:26:23.476879 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 447/901] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:26:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:26:23.487729 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-92cd6e79-8d7f-4ce4-8e21-a7ff58bf04a1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:23.488350 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-92cd6e79-8d7f-4ce4-8e21-a7ff58bf04a1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:23.548148 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-92cd6e79-8d7f-4ce4-8e21-a7ff58bf04a1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:23.556306 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-92cd6e79-8d7f-4ce4-8e21-a7ff58bf04a1 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1219 microversion: 2.1 time: 0.072815 May 26 18:26:23.556951 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 455/902] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:23 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:23.750914 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1659184788", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1204774411", "security_groups": [{"name": "tempest-secgroup-smoke-1433868789"}], "networks": [{"uuid": "3a0d0cc3-8962-4660-a65f-5ca43cd3dfe5"}], "block_device_mapping_v2": [{"uuid": "1c6a53cd-85f0-45ce-aecc-e9d1507b5b6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:23.867985 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] validate_networks() for [('3a0d0cc3-8962-4660-a65f-5ca43cd3dfe5', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:26:24.253202 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:26:24.253790 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:26:24.254137 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:26:24.254547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:26:24.254993 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:26:24.263953 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:24.264400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:24.265191 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:24.265628 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:24.283084 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Getting quotas for project 564690a570ea4ec199dc599d288756b0. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:26:24.286785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Getting quotas for user 73559b7886614dd2a92e9c6c53307331 and project 564690a570ea4ec199dc599d288756b0. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:26:24.353537 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:26:24.356426 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c6a53cd-85f0-45ce-aecc-e9d1507b5b6b',volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:26:24.507241 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8eafe599-a93e-40a3-aceb-c5d95e70d7dc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760212 May 26 18:26:24.507814 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 448/903] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:26:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:26:24.522700 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a4df4ab2-b914-4f0c-86af-38e140452dc6 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:24.523317 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a4df4ab2-b914-4f0c-86af-38e140452dc6 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:24.526490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:24.574676 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-54c1657c-2feb-4706-aec2-66e4dcca91fe tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:24.575300 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-54c1657c-2feb-4706-aec2-66e4dcca91fe tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:24.581746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54c1657c-2feb-4706-aec2-66e4dcca91fe tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:24.582226 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54c1657c-2feb-4706-aec2-66e4dcca91fe tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:24.582998 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54c1657c-2feb-4706-aec2-66e4dcca91fe tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:24.583430 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54c1657c-2feb-4706-aec2-66e4dcca91fe tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:24.599957 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a4df4ab2-b914-4f0c-86af-38e140452dc6 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:24.609183 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a4df4ab2-b914-4f0c-86af-38e140452dc6 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1089 microversion: 2.1 time: 0.092686 May 26 18:26:24.625581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 456/904] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:24 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1089 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:24.675211 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-54c1657c-2feb-4706-aec2-66e4dcca91fe tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:24.684275 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-54c1657c-2feb-4706-aec2-66e4dcca91fe tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1277 microversion: 2.1 time: 0.114295 May 26 18:26:24.684891 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 449/905] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:24 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:25.633023 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9ef03ea4-35f6-4519-be31-82ee07c30a3a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:25.633639 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9ef03ea4-35f6-4519-be31-82ee07c30a3a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:25.641693 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ef03ea4-35f6-4519-be31-82ee07c30a3a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:25.642173 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ef03ea4-35f6-4519-be31-82ee07c30a3a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:25.642953 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ef03ea4-35f6-4519-be31-82ee07c30a3a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:25.643391 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9ef03ea4-35f6-4519-be31-82ee07c30a3a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:25.702348 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a8f06961-e122-4325-aaf3-4630d0fc52c6 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:25.702963 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a8f06961-e122-4325-aaf3-4630d0fc52c6 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:25.709435 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8f06961-e122-4325-aaf3-4630d0fc52c6 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:25.709917 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8f06961-e122-4325-aaf3-4630d0fc52c6 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:25.710733 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8f06961-e122-4325-aaf3-4630d0fc52c6 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:25.711144 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a8f06961-e122-4325-aaf3-4630d0fc52c6 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:25.760396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9ef03ea4-35f6-4519-be31-82ee07c30a3a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:25.768021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9ef03ea4-35f6-4519-be31-82ee07c30a3a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1205 microversion: 2.1 time: 0.138880 May 26 18:26:25.779553 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 457/906] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:25 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1205 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:26.038786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a8f06961-e122-4325-aaf3-4630d0fc52c6 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:26.048162 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a8f06961-e122-4325-aaf3-4630d0fc52c6 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1319 microversion: 2.1 time: 0.349491 May 26 18:26:26.049143 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 450/907] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:25 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:26:26.530581 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-4aab66c4-5600-4ae6-a40a-e2be2ad67b8b req-904b8b6d-8524-4f99-a745-635a38c1ee26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4583e77c-94a2-4fee-8dd0-ced3afc79cb7", "tag": "bd00fd62-0bdd-4564-bd56-66c6d8d3a4b8"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:26.543876 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4aab66c4-5600-4ae6-a40a-e2be2ad67b8b req-904b8b6d-8524-4f99-a745-635a38c1ee26 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:26.544280 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-4aab66c4-5600-4ae6-a40a-e2be2ad67b8b req-904b8b6d-8524-4f99-a745-635a38c1ee26 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:26.558371 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-4aab66c4-5600-4ae6-a40a-e2be2ad67b8b req-904b8b6d-8524-4f99-a745-635a38c1ee26 service nova] Creating event network-changed:bd00fd62-0bdd-4564-bd56-66c6d8d3a4b8 for instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 on hv-cinder-84349 May 26 18:26:26.573427 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-4aab66c4-5600-4ae6-a40a-e2be2ad67b8b req-904b8b6d-8524-4f99-a745-635a38c1ee26 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049196 May 26 18:26:26.574122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 458/908] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:26.786122 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cf716e1a-0af6-4e3a-91eb-a8a6f65521ef tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:26.786928 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-cf716e1a-0af6-4e3a-91eb-a8a6f65521ef tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:26.794843 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf716e1a-0af6-4e3a-91eb-a8a6f65521ef tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:26.795308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf716e1a-0af6-4e3a-91eb-a8a6f65521ef tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:26.796217 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf716e1a-0af6-4e3a-91eb-a8a6f65521ef tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:26.796731 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf716e1a-0af6-4e3a-91eb-a8a6f65521ef tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:27.067590 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-88f8c427-8b65-4276-a4a0-28fa11a1120e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:27.068174 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-88f8c427-8b65-4276-a4a0-28fa11a1120e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:27.075100 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-88f8c427-8b65-4276-a4a0-28fa11a1120e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:27.075591 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-88f8c427-8b65-4276-a4a0-28fa11a1120e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:27.076377 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-88f8c427-8b65-4276-a4a0-28fa11a1120e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:27.076940 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-88f8c427-8b65-4276-a4a0-28fa11a1120e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:27.415667 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-cf716e1a-0af6-4e3a-91eb-a8a6f65521ef tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:27.424524 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-cf716e1a-0af6-4e3a-91eb-a8a6f65521ef tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.642517 May 26 18:26:27.425126 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 451/909] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:26 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:27.443979 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-88f8c427-8b65-4276-a4a0-28fa11a1120e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:27.451461 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-88f8c427-8b65-4276-a4a0-28fa11a1120e tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1319 microversion: 2.1 time: 0.388709 May 26 18:26:27.452034 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 459/910] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:27 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:26:28.442189 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9e408c12-9f1a-4035-9b9d-2f4990b54f5e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:28.442896 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9e408c12-9f1a-4035-9b9d-2f4990b54f5e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:28.450024 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e408c12-9f1a-4035-9b9d-2f4990b54f5e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:28.450442 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e408c12-9f1a-4035-9b9d-2f4990b54f5e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:28.451209 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e408c12-9f1a-4035-9b9d-2f4990b54f5e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:28.451644 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9e408c12-9f1a-4035-9b9d-2f4990b54f5e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:28.468437 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3500c6f8-ff91-4394-a871-5e5436f49bf7 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:28.469377 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3500c6f8-ff91-4394-a871-5e5436f49bf7 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:28.477318 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3500c6f8-ff91-4394-a871-5e5436f49bf7 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:28.477945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3500c6f8-ff91-4394-a871-5e5436f49bf7 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:28.479885 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3500c6f8-ff91-4394-a871-5e5436f49bf7 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:28.480640 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3500c6f8-ff91-4394-a871-5e5436f49bf7 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:28.875248 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3500c6f8-ff91-4394-a871-5e5436f49bf7 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:28.878712 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9e408c12-9f1a-4035-9b9d-2f4990b54f5e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:28.883079 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3500c6f8-ff91-4394-a871-5e5436f49bf7 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1319 microversion: 2.1 time: 0.418592 May 26 18:26:28.883831 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 460/911] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:28 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:28.889575 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9e408c12-9f1a-4035-9b9d-2f4990b54f5e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.451171 May 26 18:26:28.889891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-fa967b05-27af-4134-b4f3-e166643bbaa4 req-ac9941df-bc13-4e4b-b51b-d63090c89353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f6ccf2-1303-4597-98f1-7e21e99f403f", "tag": "f47522ae-974a-4ef1-a04e-e9c179f9d917"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:28.890118 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 452/912] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:28 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:28.898333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-fa967b05-27af-4134-b4f3-e166643bbaa4 req-ac9941df-bc13-4e4b-b51b-d63090c89353 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:28.898901 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-fa967b05-27af-4134-b4f3-e166643bbaa4 req-ac9941df-bc13-4e4b-b51b-d63090c89353 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:28.910345 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-fa967b05-27af-4134-b4f3-e166643bbaa4 req-ac9941df-bc13-4e4b-b51b-d63090c89353 service nova] Creating event network-changed:f47522ae-974a-4ef1-a04e-e9c179f9d917 for instance 71f6ccf2-1303-4597-98f1-7e21e99f403f on hv-cinder-84349 May 26 18:26:28.915050 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-fa967b05-27af-4134-b4f3-e166643bbaa4 req-ac9941df-bc13-4e4b-b51b-d63090c89353 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029031 May 26 18:26:28.915785 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 461/913] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:29.899483 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0bad8c58-8ce3-40e9-ae8b-990edf3e2343 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:29.900181 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0bad8c58-8ce3-40e9-ae8b-990edf3e2343 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:29.907350 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0bad8c58-8ce3-40e9-ae8b-990edf3e2343 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:29.907803 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0bad8c58-8ce3-40e9-ae8b-990edf3e2343 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:29.908580 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0bad8c58-8ce3-40e9-ae8b-990edf3e2343 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:29.909019 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0bad8c58-8ce3-40e9-ae8b-990edf3e2343 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:29.909558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-75145434-e832-4f94-8c83-a9aa6867aeed tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:29.910293 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-75145434-e832-4f94-8c83-a9aa6867aeed tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:29.917089 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75145434-e832-4f94-8c83-a9aa6867aeed tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:29.917984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75145434-e832-4f94-8c83-a9aa6867aeed tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:29.918772 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75145434-e832-4f94-8c83-a9aa6867aeed tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:29.919208 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-75145434-e832-4f94-8c83-a9aa6867aeed tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:30.110216 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0bad8c58-8ce3-40e9-ae8b-990edf3e2343 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:30.114752 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-75145434-e832-4f94-8c83-a9aa6867aeed tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:30.117662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0bad8c58-8ce3-40e9-ae8b-990edf3e2343 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1319 microversion: 2.1 time: 0.222212 May 26 18:26:30.118337 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 453/914] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:29 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:30.123144 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-75145434-e832-4f94-8c83-a9aa6867aeed tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.218124 May 26 18:26:30.123735 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 462/915] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:29 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:26:31.137022 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-87b5fa67-6b3d-43fe-9370-885a82358c3c tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:31.137641 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-87b5fa67-6b3d-43fe-9370-885a82358c3c tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:31.140403 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-47bf698d-001c-470a-a1b8-4e76c3ebd227 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:31.141145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-47bf698d-001c-470a-a1b8-4e76c3ebd227 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:31.144329 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87b5fa67-6b3d-43fe-9370-885a82358c3c tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:31.144783 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87b5fa67-6b3d-43fe-9370-885a82358c3c tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:31.145552 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87b5fa67-6b3d-43fe-9370-885a82358c3c tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:31.146030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-87b5fa67-6b3d-43fe-9370-885a82358c3c tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:31.147604 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-47bf698d-001c-470a-a1b8-4e76c3ebd227 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:31.148047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-47bf698d-001c-470a-a1b8-4e76c3ebd227 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:31.148800 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-47bf698d-001c-470a-a1b8-4e76c3ebd227 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:31.149232 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-47bf698d-001c-470a-a1b8-4e76c3ebd227 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:31.342494 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-87b5fa67-6b3d-43fe-9370-885a82358c3c tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:31.346216 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-47bf698d-001c-470a-a1b8-4e76c3ebd227 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:31.350163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-87b5fa67-6b3d-43fe-9370-885a82358c3c tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1319 microversion: 2.1 time: 0.217262 May 26 18:26:31.350746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 454/916] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:31 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:31.353945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-47bf698d-001c-470a-a1b8-4e76c3ebd227 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.217372 May 26 18:26:31.354597 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 463/917] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:31 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:31.899307 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-29ae8128-8879-4061-8832-c52b2383fb97 req-a9b42ced-7674-4c8e-af15-4bd1321b5caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4583e77c-94a2-4fee-8dd0-ced3afc79cb7", "name": "network-vif-plugged", "status": "completed", "tag": "bd00fd62-0bdd-4564-bd56-66c6d8d3a4b8"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:31.907515 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-29ae8128-8879-4061-8832-c52b2383fb97 req-a9b42ced-7674-4c8e-af15-4bd1321b5caa service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:31.907984 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-29ae8128-8879-4061-8832-c52b2383fb97 req-a9b42ced-7674-4c8e-af15-4bd1321b5caa service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:31.919766 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-29ae8128-8879-4061-8832-c52b2383fb97 req-a9b42ced-7674-4c8e-af15-4bd1321b5caa service nova] Creating event network-vif-plugged:bd00fd62-0bdd-4564-bd56-66c6d8d3a4b8 for instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 on hv-cinder-84349 May 26 18:26:31.924574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-29ae8128-8879-4061-8832-c52b2383fb97 req-a9b42ced-7674-4c8e-af15-4bd1321b5caa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029041 May 26 18:26:31.925166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 455/918] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:32.367079 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-05fb31ff-c5d3-43eb-9f2a-690b454f6d64 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:32.367614 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-05fb31ff-c5d3-43eb-9f2a-690b454f6d64 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:32.371694 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8c952840-f0e2-43a2-9a39-689b1757a194 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:32.372409 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8c952840-f0e2-43a2-9a39-689b1757a194 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:32.375071 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05fb31ff-c5d3-43eb-9f2a-690b454f6d64 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:32.375517 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05fb31ff-c5d3-43eb-9f2a-690b454f6d64 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:32.376278 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05fb31ff-c5d3-43eb-9f2a-690b454f6d64 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:32.376706 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-05fb31ff-c5d3-43eb-9f2a-690b454f6d64 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:32.378715 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8c952840-f0e2-43a2-9a39-689b1757a194 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:32.379206 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8c952840-f0e2-43a2-9a39-689b1757a194 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:32.379971 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8c952840-f0e2-43a2-9a39-689b1757a194 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:32.380412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8c952840-f0e2-43a2-9a39-689b1757a194 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:32.574728 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-05fb31ff-c5d3-43eb-9f2a-690b454f6d64 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:32.579083 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8c952840-f0e2-43a2-9a39-689b1757a194 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:32.582368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-05fb31ff-c5d3-43eb-9f2a-690b454f6d64 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1319 microversion: 2.1 time: 0.219270 May 26 18:26:32.582945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 464/919] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:32 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:32.586731 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8c952840-f0e2-43a2-9a39-689b1757a194 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.220443 May 26 18:26:32.587306 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 456/920] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:32 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:26:33.600046 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fa3d4d98-8097-423d-895e-a17a2bff5497 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:33.600680 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fa3d4d98-8097-423d-895e-a17a2bff5497 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:33.602888 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3f7a21ea-5d1c-4608-b6f3-f588c7dbab4e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:33.604005 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-3f7a21ea-5d1c-4608-b6f3-f588c7dbab4e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:33.608224 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa3d4d98-8097-423d-895e-a17a2bff5497 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:33.608678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa3d4d98-8097-423d-895e-a17a2bff5497 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:33.609579 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa3d4d98-8097-423d-895e-a17a2bff5497 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:33.610104 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fa3d4d98-8097-423d-895e-a17a2bff5497 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:33.611313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3f7a21ea-5d1c-4608-b6f3-f588c7dbab4e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:33.611765 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3f7a21ea-5d1c-4608-b6f3-f588c7dbab4e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:33.612544 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3f7a21ea-5d1c-4608-b6f3-f588c7dbab4e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:33.613020 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3f7a21ea-5d1c-4608-b6f3-f588c7dbab4e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:33.797606 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fa3d4d98-8097-423d-895e-a17a2bff5497 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:33.805855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fa3d4d98-8097-423d-895e-a17a2bff5497 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1508 microversion: 2.1 time: 0.209630 May 26 18:26:33.806488 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 465/921] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:33 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:33.807316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-3f7a21ea-5d1c-4608-b6f3-f588c7dbab4e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:33.815107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-3f7a21ea-5d1c-4608-b6f3-f588c7dbab4e tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.215919 May 26 18:26:33.815592 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 457/922] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:33 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:26:33.823556 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a0d1ed8a-93a5-4435-9cc5-f57aac2df33b tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f056af5a-4f45-426a-a254-3d8537d8dba4", "device": "/dev/sdb"}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:33.825202 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a0d1ed8a-93a5-4435-9cc5-f57aac2df33b tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:33.835958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a0d1ed8a-93a5-4435-9cc5-f57aac2df33b tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:33.836406 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a0d1ed8a-93a5-4435-9cc5-f57aac2df33b tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:33.837412 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a0d1ed8a-93a5-4435-9cc5-f57aac2df33b tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:33.838891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a0d1ed8a-93a5-4435-9cc5-f57aac2df33b tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:34.077185 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a0d1ed8a-93a5-4435-9cc5-f57aac2df33b tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "POST /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258184 May 26 18:26:34.077873 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 466/923] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 18:26:33 2022] POST /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:34.834156 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-59925258-6a04-44db-b8f1-c5d10acff78d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:34.834780 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-59925258-6a04-44db-b8f1-c5d10acff78d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:34.836748 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=4 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:34.837442 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=12 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:34.844658 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-59925258-6a04-44db-b8f1-c5d10acff78d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:34.845112 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-59925258-6a04-44db-b8f1-c5d10acff78d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:34.845922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-59925258-6a04-44db-b8f1-c5d10acff78d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:34.846370 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-59925258-6a04-44db-b8f1-c5d10acff78d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:34.983450 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-59925258-6a04-44db-b8f1-c5d10acff78d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:34.991070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-59925258-6a04-44db-b8f1-c5d10acff78d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.161119 May 26 18:26:34.991633 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 458/924] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:34 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:36.008866 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-1561586b-8048-4c82-a847-32672eec7940 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:36.009582 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-1561586b-8048-4c82-a847-32672eec7940 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:36.012038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:36.017988 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1561586b-8048-4c82-a847-32672eec7940 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:36.018433 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1561586b-8048-4c82-a847-32672eec7940 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:36.019197 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1561586b-8048-4c82-a847-32672eec7940 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:36.019632 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-1561586b-8048-4c82-a847-32672eec7940 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:36.149346 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-1561586b-8048-4c82-a847-32672eec7940 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:36.161214 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-1561586b-8048-4c82-a847-32672eec7940 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.156447 May 26 18:26:36.163069 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 467/925] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:36 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:37.183308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ec83dbbd-d6e8-4251-ba77-04aecd324ae9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:37.184284 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ec83dbbd-d6e8-4251-ba77-04aecd324ae9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:37.191077 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ec83dbbd-d6e8-4251-ba77-04aecd324ae9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:37.191522 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ec83dbbd-d6e8-4251-ba77-04aecd324ae9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:37.192631 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ec83dbbd-d6e8-4251-ba77-04aecd324ae9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:37.193107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ec83dbbd-d6e8-4251-ba77-04aecd324ae9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:37.336796 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ec83dbbd-d6e8-4251-ba77-04aecd324ae9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:37.344806 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ec83dbbd-d6e8-4251-ba77-04aecd324ae9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.165798 May 26 18:26:37.345424 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 459/926] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:37 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:37.978152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-60a3f742-60eb-4e77-9590-0465fb2fd009 req-852eb05b-2fcf-48fa-8c41-4a9480b53603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f6ccf2-1303-4597-98f1-7e21e99f403f", "name": "network-vif-plugged", "status": "completed", "tag": "f47522ae-974a-4ef1-a04e-e9c179f9d917"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:37.988816 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-60a3f742-60eb-4e77-9590-0465fb2fd009 req-852eb05b-2fcf-48fa-8c41-4a9480b53603 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:37.989273 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-60a3f742-60eb-4e77-9590-0465fb2fd009 req-852eb05b-2fcf-48fa-8c41-4a9480b53603 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:38.001904 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-60a3f742-60eb-4e77-9590-0465fb2fd009 req-852eb05b-2fcf-48fa-8c41-4a9480b53603 service nova] Creating event network-vif-plugged:f47522ae-974a-4ef1-a04e-e9c179f9d917 for instance 71f6ccf2-1303-4597-98f1-7e21e99f403f on hv-cinder-84349 May 26 18:26:38.006809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-60a3f742-60eb-4e77-9590-0465fb2fd009 req-852eb05b-2fcf-48fa-8c41-4a9480b53603 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 May 26 18:26:38.007407 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 468/927] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:38.364221 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-97bbce40-b2ef-45c2-ab4f-99ee55788f56 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:38.364875 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-97bbce40-b2ef-45c2-ab4f-99ee55788f56 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:38.372017 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97bbce40-b2ef-45c2-ab4f-99ee55788f56 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:38.372474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97bbce40-b2ef-45c2-ab4f-99ee55788f56 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:38.373236 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97bbce40-b2ef-45c2-ab4f-99ee55788f56 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:38.373678 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-97bbce40-b2ef-45c2-ab4f-99ee55788f56 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:38.510338 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-97bbce40-b2ef-45c2-ab4f-99ee55788f56 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:38.518874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-97bbce40-b2ef-45c2-ab4f-99ee55788f56 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1261 microversion: 2.1 time: 0.158427 May 26 18:26:38.519464 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 460/928] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:38 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:39.537124 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-8c5e56fd-ecb5-44a0-be10-0fed0f6427e5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:39.537888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-8c5e56fd-ecb5-44a0-be10-0fed0f6427e5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:39.539823 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=41 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:39.546445 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c5e56fd-ecb5-44a0-be10-0fed0f6427e5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:39.546887 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c5e56fd-ecb5-44a0-be10-0fed0f6427e5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:39.547638 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c5e56fd-ecb5-44a0-be10-0fed0f6427e5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:39.548070 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-8c5e56fd-ecb5-44a0-be10-0fed0f6427e5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:39.688811 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-8c5e56fd-ecb5-44a0-be10-0fed0f6427e5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:39.697058 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-8c5e56fd-ecb5-44a0-be10-0fed0f6427e5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1444 microversion: 2.1 time: 0.164566 May 26 18:26:39.697628 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 469/929] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:39 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:39.714483 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8717b966-19cc-4ccc-ae4f-df2ad04eee42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:39.715422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8717b966-19cc-4ccc-ae4f-df2ad04eee42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:39.722033 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8717b966-19cc-4ccc-ae4f-df2ad04eee42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:39.722490 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8717b966-19cc-4ccc-ae4f-df2ad04eee42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:39.723258 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8717b966-19cc-4ccc-ae4f-df2ad04eee42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:39.723716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8717b966-19cc-4ccc-ae4f-df2ad04eee42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:39.851479 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8717b966-19cc-4ccc-ae4f-df2ad04eee42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:39.859839 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8717b966-19cc-4ccc-ae4f-df2ad04eee42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1444 microversion: 2.1 time: 0.149761 May 26 18:26:39.860413 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 461/930] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:39 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:41.639908 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-6b83e884-2b1f-4f87-93ed-af9be4075b3f req-5c65a0db-a7d3-4fbe-b418-5a2d52c3369e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f6ccf2-1303-4597-98f1-7e21e99f403f", "tag": "f47522ae-974a-4ef1-a04e-e9c179f9d917"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:41.648692 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6b83e884-2b1f-4f87-93ed-af9be4075b3f req-5c65a0db-a7d3-4fbe-b418-5a2d52c3369e service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:41.649194 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6b83e884-2b1f-4f87-93ed-af9be4075b3f req-5c65a0db-a7d3-4fbe-b418-5a2d52c3369e service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:41.661847 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-6b83e884-2b1f-4f87-93ed-af9be4075b3f req-5c65a0db-a7d3-4fbe-b418-5a2d52c3369e service nova] Creating event network-changed:f47522ae-974a-4ef1-a04e-e9c179f9d917 for instance 71f6ccf2-1303-4597-98f1-7e21e99f403f on hv-cinder-84349 May 26 18:26:41.668280 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-6b83e884-2b1f-4f87-93ed-af9be4075b3f req-5c65a0db-a7d3-4fbe-b418-5a2d52c3369e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109013 May 26 18:26:41.669617 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 470/931] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:52.421389 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ab0bc29b-dcb2-4890-bb71-12fe1b44e3eb tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:52.421910 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ab0bc29b-dcb2-4890-bb71-12fe1b44e3eb tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:52.424367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:52.425012 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=78 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:52.431136 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ab0bc29b-dcb2-4890-bb71-12fe1b44e3eb tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:52.431581 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ab0bc29b-dcb2-4890-bb71-12fe1b44e3eb tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:52.433036 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ab0bc29b-dcb2-4890-bb71-12fe1b44e3eb tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:52.433602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ab0bc29b-dcb2-4890-bb71-12fe1b44e3eb tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:52.516743 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-ab0bc29b-dcb2-4890-bb71-12fe1b44e3eb tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lazy-loading 'services' on Instance uuid 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:26:52.593314 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ab0bc29b-dcb2-4890-bb71-12fe1b44e3eb tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7/os-volume_attachments/f056af5a-4f45-426a-a254-3d8537d8dba4" status: 202 len: 0 microversion: 2.1 time: 0.176216 May 26 18:26:52.594107 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 462/932] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 18:26:52 2022] DELETE /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7/os-volume_attachments/f056af5a-4f45-426a-a254-3d8537d8dba4 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:26:53.704817 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=3 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:53.705555 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:53.709563 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-73bc29bf-1967-4c8a-80d7-6494274f9756 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:53.710172 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-73bc29bf-1967-4c8a-80d7-6494274f9756 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:53.718822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73bc29bf-1967-4c8a-80d7-6494274f9756 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:53.719272 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73bc29bf-1967-4c8a-80d7-6494274f9756 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:53.720045 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73bc29bf-1967-4c8a-80d7-6494274f9756 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:53.720484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-73bc29bf-1967-4c8a-80d7-6494274f9756 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:53.748308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-73bc29bf-1967-4c8a-80d7-6494274f9756 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:26:53.833645 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-73bc29bf-1967-4c8a-80d7-6494274f9756 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 204 len: 0 microversion: 2.1 time: 0.130007 May 26 18:26:53.834368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 471/933] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:26:53 2022] DELETE /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:26:53.844650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4cd3e789-e3f8-4be9-9f9c-7b6fbbb2d3a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:53.845345 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4cd3e789-e3f8-4be9-9f9c-7b6fbbb2d3a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:53.852015 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4cd3e789-e3f8-4be9-9f9c-7b6fbbb2d3a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:53.852463 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4cd3e789-e3f8-4be9-9f9c-7b6fbbb2d3a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:53.853215 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4cd3e789-e3f8-4be9-9f9c-7b6fbbb2d3a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:53.853645 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4cd3e789-e3f8-4be9-9f9c-7b6fbbb2d3a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:53.986203 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4cd3e789-e3f8-4be9-9f9c-7b6fbbb2d3a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:53.993655 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4cd3e789-e3f8-4be9-9f9c-7b6fbbb2d3a2 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1514 microversion: 2.1 time: 0.153522 May 26 18:26:53.994261 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 463/934] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:53 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:26:55.012069 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-0da6acca-55e7-4adf-93d7-41b24e14d75f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:55.012784 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-0da6acca-55e7-4adf-93d7-41b24e14d75f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:55.019423 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0da6acca-55e7-4adf-93d7-41b24e14d75f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:55.019945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0da6acca-55e7-4adf-93d7-41b24e14d75f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:55.020720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0da6acca-55e7-4adf-93d7-41b24e14d75f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:55.021167 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-0da6acca-55e7-4adf-93d7-41b24e14d75f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:55.150600 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-0da6acca-55e7-4adf-93d7-41b24e14d75f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:55.158760 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-0da6acca-55e7-4adf-93d7-41b24e14d75f tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1514 microversion: 2.1 time: 0.151148 May 26 18:26:55.159332 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 472/935] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:55 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:26:55.929669 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-5a9b663e-9216-48fc-b809-a180ab9b1810 req-3c08994d-e3a6-46ad-ae4f-756d6a7b0992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4583e77c-94a2-4fee-8dd0-ced3afc79cb7", "name": "network-vif-deleted", "tag": "bd00fd62-0bdd-4564-bd56-66c6d8d3a4b8"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:26:55.939220 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-5a9b663e-9216-48fc-b809-a180ab9b1810 req-3c08994d-e3a6-46ad-ae4f-756d6a7b0992 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:55.939673 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-5a9b663e-9216-48fc-b809-a180ab9b1810 req-3c08994d-e3a6-46ad-ae4f-756d6a7b0992 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:55.951945 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-5a9b663e-9216-48fc-b809-a180ab9b1810 req-3c08994d-e3a6-46ad-ae4f-756d6a7b0992 service nova] Creating event network-vif-deleted:bd00fd62-0bdd-4564-bd56-66c6d8d3a4b8 for instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 on hv-cinder-84349 May 26 18:26:55.957134 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-5a9b663e-9216-48fc-b809-a180ab9b1810 req-3c08994d-e3a6-46ad-ae4f-756d6a7b0992 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031616 May 26 18:26:55.957753 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 464/936] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:26:56.176316 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:56.176942 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:56.184496 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:56.184953 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:56.185745 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:56.186196 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:56.216775 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:56.217233 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:56.217683 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lazy-loading 'fault' on Instance uuid 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:26:56.259103 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f98b0f5afd497eb16ddd990dfcac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90546acc85c14828b2f1e0a906037a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:26:56.266944 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c05d658d-0e35-485d-b681-8f381db65702 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 200 len: 1309 microversion: 2.1 time: 0.094563 May 26 18:26:56.267517 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 473/937] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:56 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:26:57.285576 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:26:57.286318 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] [instance: 4583e77c-94a2-4fee-8dd0-ced3afc79cb7] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:26:57.292880 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:57.293325 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:57.294124 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:26:57.294562 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:26:57.308742 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] HTTP exception thrown: Instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 could not be found. May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Request method failure captured: May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 HTTP/1.1 May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8YOfM7UNikPv9doTzmKBoYBHg_8-RS9FXf1ZVz0E5Z5mE_S7C8PaijVe5GNBuE8RBqapMA-c6uDq5C5IDM8n4RuaS0lZMC-unsmHagLsmWQHY-94w0jD-pGw1I6mKwg-WWZIbpAIYmDgcKMdej4fiZUqEFmA-YVOoqLlNCOsLbZm_o May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 90546acc85c14828b2f1e0a906037a9c May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1240623288 May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:26:57.310328 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/90546acc85c14828b2f1e0a906037a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/90546acc85c14828b2f1e0a906037a9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/90546acc85c14828b2f1e0a906037a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_90546acc85c14828b2f1e0a906037a9c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-VolumesSnapshotTestJSON-1240623288 May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 90546acc85c14828b2f1e0a906037a9c May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1240623288 May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-VolumesSnapshotTestJSON-1240623288-project May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 42f98b0f5afd497eb16ddd990dfcac26 May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-VolumesSnapshotTestJSON-1240623288-project May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 could not be found. May 26 18:26:57.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '4583e77c-94a2-4fee-8dd0-ced3afc79cb7'} May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 could not be found. May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:26:57.312950 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 could not be found. May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 could not be found. May 26 18:26:57.314622 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:26:57.316331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] Returning 404 to user: Instance 4583e77c-94a2-4fee-8dd0-ced3afc79cb7 could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:26:57.316331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-be07ab94-0ec8-4f6b-8b66-577665179ef9 tempest-VolumesSnapshotTestJSON-1240623288 tempest-VolumesSnapshotTestJSON-1240623288-project] 10.222.0.46 "GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7" status: 404 len: 111 microversion: 2.1 time: 0.031018 May 26 18:26:57.316331 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 465/938] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:26:57 2022] GET /compute/v2.1/servers/4583e77c-94a2-4fee-8dd0-ced3afc79cb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:27:38.616500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:38.617235 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:38.804997 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-57697376-4cd7-457e-98ce-272f014997b5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Action: 'create', calling method: .version_select at 0x7f5f184503a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2004287902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfzuZRjA1GAPWDa5eC+888/ZkvZD2PtY1LOCLu6np9MktcndGkKa572I9ccIJIc++A/y6Aj8Bdb01gu6Rve10SdCFXFV0+EY56qfisY9K8wL4kCdz2K30qCjKfTQvbGqA=="}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:27:38.819259 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-57697376-4cd7-457e-98ce-272f014997b5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Getting quotas for project 6774c3ce4b094e19ad6da95e3744d9ed. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:27:38.823412 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-57697376-4cd7-457e-98ce-272f014997b5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Getting quotas for user 7cde3488be6c4c8790841b7529123326 and project 6774c3ce4b094e19ad6da95e3744d9ed. Resources: {'key_pairs'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:27:38.836319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR oslo.messaging._drivers.impl_rabbit [None req-57697376-4cd7-457e-98ce-272f014997b5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [fea7d9f3-4468-49f9-ad17-f0c457296c51] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 18:27:39.845997 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [None req-57697376-4cd7-457e-98ce-272f014997b5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [fea7d9f3-4468-49f9-ad17-f0c457296c51] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42582. May 26 18:27:39.876504 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-57697376-4cd7-457e-98ce-272f014997b5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.264877 May 26 18:27:39.878489 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 474/939] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 18:27:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:27:55.314574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-27500384", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2004287902", "security_groups": [{"name": "tempest-secgroup-smoke-981813776"}], "block_device_mapping_v2": [{"uuid": "5c4c016c-e812-4606-95e0-a93a54af3acf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b8a2aca-5692-49b8-9e87-22b18005ff6f"}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:27:55.324535 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=8 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:55.324859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:55.556269 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] validate_networks() for [('6b8a2aca-5692-49b8-9e87-22b18005ff6f', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:27:56.060646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:27:56.061063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:27:56.061549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:27:56.062070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:27:56.062527 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:27:56.071335 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:27:56.071779 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:27:56.072571 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:27:56.073631 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:27:56.091433 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Getting quotas for project 6774c3ce4b094e19ad6da95e3744d9ed. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:27:56.095402 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Getting quotas for user 7cde3488be6c4c8790841b7529123326 and project 6774c3ce4b094e19ad6da95e3744d9ed. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:27:56.170804 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:27:56.172958 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c4c016c-e812-4606-95e0-a93a54af3acf',volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:27:56.312942 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4991d080-0763-495d-bdf1-c012f9a4e3ac tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.002350 May 26 18:27:56.313610 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 466/940] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:27:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:27:56.322687 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=4 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:56.325323 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:56.330810 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4bbd4054-19d3-4fa9-a2ee-f157ca0e1ff9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:27:56.331599 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4bbd4054-19d3-4fa9-a2ee-f157ca0e1ff9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:27:56.484655 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4bbd4054-19d3-4fa9-a2ee-f157ca0e1ff9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:27:56.497193 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4bbd4054-19d3-4fa9-a2ee-f157ca0e1ff9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1093 microversion: 2.1 time: 0.176632 May 26 18:27:56.498169 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 475/941] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:27:56 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1093 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:27:57.516157 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-96af7bbb-cab7-4ece-98c5-31cd23ad2bde tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:27:57.516778 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-96af7bbb-cab7-4ece-98c5-31cd23ad2bde tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:27:57.525161 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-96af7bbb-cab7-4ece-98c5-31cd23ad2bde tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:27:57.525961 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-96af7bbb-cab7-4ece-98c5-31cd23ad2bde tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:27:57.526925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-96af7bbb-cab7-4ece-98c5-31cd23ad2bde tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:27:57.527374 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-96af7bbb-cab7-4ece-98c5-31cd23ad2bde tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:27:57.874011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-96af7bbb-cab7-4ece-98c5-31cd23ad2bde tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:27:57.883547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-96af7bbb-cab7-4ece-98c5-31cd23ad2bde tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1209 microversion: 2.1 time: 0.372435 May 26 18:27:57.884186 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 467/942] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:27:57 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1209 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:27:58.901464 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-4fa0b864-0237-4e2b-9d15-9396cb76dcaa tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:27:58.902274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-4fa0b864-0237-4e2b-9d15-9396cb76dcaa tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:27:58.909074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fa0b864-0237-4e2b-9d15-9396cb76dcaa tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:27:58.909533 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fa0b864-0237-4e2b-9d15-9396cb76dcaa tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:27:58.910490 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fa0b864-0237-4e2b-9d15-9396cb76dcaa tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:27:58.910938 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-4fa0b864-0237-4e2b-9d15-9396cb76dcaa tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:27:59.176525 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-4fa0b864-0237-4e2b-9d15-9396cb76dcaa tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:27:59.189038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-4fa0b864-0237-4e2b-9d15-9396cb76dcaa tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.291396 May 26 18:27:59.190708 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 476/943] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:27:58 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:27:59.336375 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-8fd8bd15-55ed-4c37-abd0-fe7e51f699c8 req-82abb440-3175-47e3-b1e0-f495f6ea53f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f76001-148d-4c5f-a8b8-a1f881a6033e", "tag": "bc0fe5cb-055f-44c6-92c5-5908d09f787b"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:27:59.359772 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-8fd8bd15-55ed-4c37-abd0-fe7e51f699c8 req-82abb440-3175-47e3-b1e0-f495f6ea53f5 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:27:59.360219 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-8fd8bd15-55ed-4c37-abd0-fe7e51f699c8 req-82abb440-3175-47e3-b1e0-f495f6ea53f5 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:27:59.374385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-8fd8bd15-55ed-4c37-abd0-fe7e51f699c8 req-82abb440-3175-47e3-b1e0-f495f6ea53f5 service nova] Creating event network-changed:bc0fe5cb-055f-44c6-92c5-5908d09f787b for instance b5f76001-148d-4c5f-a8b8-a1f881a6033e on hv-cinder-84349 May 26 18:27:59.380271 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-8fd8bd15-55ed-4c37-abd0-fe7e51f699c8 req-82abb440-3175-47e3-b1e0-f495f6ea53f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049557 May 26 18:27:59.381209 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 468/944] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:28:00.212930 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-227e5995-20b4-4a87-a29f-83ae2a754b10 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:00.214296 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-227e5995-20b4-4a87-a29f-83ae2a754b10 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:00.221596 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-227e5995-20b4-4a87-a29f-83ae2a754b10 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:00.222084 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-227e5995-20b4-4a87-a29f-83ae2a754b10 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:00.222870 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-227e5995-20b4-4a87-a29f-83ae2a754b10 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:00.223315 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-227e5995-20b4-4a87-a29f-83ae2a754b10 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:00.460632 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-227e5995-20b4-4a87-a29f-83ae2a754b10 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:00.472316 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-227e5995-20b4-4a87-a29f-83ae2a754b10 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.263017 May 26 18:28:00.473175 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 477/945] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:00 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:01.493385 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-bee62d12-0cd8-4e44-9360-f9d6d380114a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:01.494294 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-bee62d12-0cd8-4e44-9360-f9d6d380114a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:01.502221 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bee62d12-0cd8-4e44-9360-f9d6d380114a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:01.502810 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bee62d12-0cd8-4e44-9360-f9d6d380114a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:01.503749 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bee62d12-0cd8-4e44-9360-f9d6d380114a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:01.504364 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-bee62d12-0cd8-4e44-9360-f9d6d380114a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:01.663308 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-bee62d12-0cd8-4e44-9360-f9d6d380114a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:01.673317 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-bee62d12-0cd8-4e44-9360-f9d6d380114a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.184610 May 26 18:28:01.673936 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 469/946] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:01 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:28:02.691374 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-df0cc7e4-af14-4d1d-9210-b2d2e6e6f516 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:02.692074 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-df0cc7e4-af14-4d1d-9210-b2d2e6e6f516 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:02.699739 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df0cc7e4-af14-4d1d-9210-b2d2e6e6f516 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:02.700194 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df0cc7e4-af14-4d1d-9210-b2d2e6e6f516 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:02.700978 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df0cc7e4-af14-4d1d-9210-b2d2e6e6f516 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:02.701419 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-df0cc7e4-af14-4d1d-9210-b2d2e6e6f516 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:02.858644 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-df0cc7e4-af14-4d1d-9210-b2d2e6e6f516 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:02.867015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-df0cc7e4-af14-4d1d-9210-b2d2e6e6f516 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.179773 May 26 18:28:02.867611 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 478/947] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:02 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:03.039129 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:28:03.039341 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Thu May 26 18:28:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:28:03.885160 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9005febc-bd42-4982-b10f-71c8b7619eef tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:03.885857 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9005febc-bd42-4982-b10f-71c8b7619eef tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:03.892801 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9005febc-bd42-4982-b10f-71c8b7619eef tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:03.893142 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9005febc-bd42-4982-b10f-71c8b7619eef tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:03.893947 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9005febc-bd42-4982-b10f-71c8b7619eef tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:03.894383 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9005febc-bd42-4982-b10f-71c8b7619eef tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:04.051043 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9005febc-bd42-4982-b10f-71c8b7619eef tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:04.059602 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9005febc-bd42-4982-b10f-71c8b7619eef tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.178399 May 26 18:28:04.060204 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 470/948] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:03 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:05.076950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d6fc39e0-e866-4023-adb5-8394463feed9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:05.077638 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d6fc39e0-e866-4023-adb5-8394463feed9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:05.087114 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6fc39e0-e866-4023-adb5-8394463feed9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:05.087578 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6fc39e0-e866-4023-adb5-8394463feed9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:05.088510 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6fc39e0-e866-4023-adb5-8394463feed9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:05.088950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6fc39e0-e866-4023-adb5-8394463feed9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:05.231542 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d6fc39e0-e866-4023-adb5-8394463feed9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:05.246494 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d6fc39e0-e866-4023-adb5-8394463feed9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.173134 May 26 18:28:05.247545 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 479/949] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:05 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:28:06.268555 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-b2548dbf-9f16-4d50-8a7a-fb8553a0008c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:06.269693 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-b2548dbf-9f16-4d50-8a7a-fb8553a0008c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:06.272290 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:06.273075 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=6 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:06.280679 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b2548dbf-9f16-4d50-8a7a-fb8553a0008c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:06.281570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b2548dbf-9f16-4d50-8a7a-fb8553a0008c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:06.282000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b2548dbf-9f16-4d50-8a7a-fb8553a0008c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:06.282374 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-b2548dbf-9f16-4d50-8a7a-fb8553a0008c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:06.455036 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-b2548dbf-9f16-4d50-8a7a-fb8553a0008c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:06.464254 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-b2548dbf-9f16-4d50-8a7a-fb8553a0008c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.198929 May 26 18:28:06.464851 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 471/950] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:06 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:07.481751 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a3af9287-9c82-450b-863c-67f8db67fe4c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:07.482587 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a3af9287-9c82-450b-863c-67f8db67fe4c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:07.485276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:07.491167 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a3af9287-9c82-450b-863c-67f8db67fe4c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:07.491623 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a3af9287-9c82-450b-863c-67f8db67fe4c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:07.492424 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a3af9287-9c82-450b-863c-67f8db67fe4c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:07.492861 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a3af9287-9c82-450b-863c-67f8db67fe4c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:07.643622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a3af9287-9c82-450b-863c-67f8db67fe4c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:07.653211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a3af9287-9c82-450b-863c-67f8db67fe4c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.176385 May 26 18:28:07.653808 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 480/951] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:07 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:08.312938 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-fb806105-f92e-4e6c-8a32-e8db7e79ae7d req-f9aecd8e-4b8a-4e02-8aa8-e004567ac17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f76001-148d-4c5f-a8b8-a1f881a6033e", "name": "network-vif-plugged", "status": "completed", "tag": "bc0fe5cb-055f-44c6-92c5-5908d09f787b"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:28:08.322279 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-fb806105-f92e-4e6c-8a32-e8db7e79ae7d req-f9aecd8e-4b8a-4e02-8aa8-e004567ac17b service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:08.323453 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-fb806105-f92e-4e6c-8a32-e8db7e79ae7d req-f9aecd8e-4b8a-4e02-8aa8-e004567ac17b service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:08.336289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-fb806105-f92e-4e6c-8a32-e8db7e79ae7d req-f9aecd8e-4b8a-4e02-8aa8-e004567ac17b service nova] Creating event network-vif-plugged:bc0fe5cb-055f-44c6-92c5-5908d09f787b for instance b5f76001-148d-4c5f-a8b8-a1f881a6033e on hv-cinder-84349 May 26 18:28:08.341779 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-fb806105-f92e-4e6c-8a32-e8db7e79ae7d req-f9aecd8e-4b8a-4e02-8aa8-e004567ac17b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036210 May 26 18:28:08.342377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 472/952] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:28:08.670457 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a9c2eaa3-5fce-4cab-9f17-9fbd2ffe45d6 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:08.671076 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a9c2eaa3-5fce-4cab-9f17-9fbd2ffe45d6 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:08.680668 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a9c2eaa3-5fce-4cab-9f17-9fbd2ffe45d6 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:08.680668 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a9c2eaa3-5fce-4cab-9f17-9fbd2ffe45d6 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:08.680668 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a9c2eaa3-5fce-4cab-9f17-9fbd2ffe45d6 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:08.681076 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a9c2eaa3-5fce-4cab-9f17-9fbd2ffe45d6 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:08.826367 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a9c2eaa3-5fce-4cab-9f17-9fbd2ffe45d6 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:08.840465 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a9c2eaa3-5fce-4cab-9f17-9fbd2ffe45d6 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.174247 May 26 18:28:08.841453 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 481/953] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:08 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:09.866035 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-8a3a7794-e9bc-4fae-ba82-58ba572c562a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:09.866838 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-8a3a7794-e9bc-4fae-ba82-58ba572c562a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:09.874223 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8a3a7794-e9bc-4fae-ba82-58ba572c562a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:09.874675 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8a3a7794-e9bc-4fae-ba82-58ba572c562a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:09.875456 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8a3a7794-e9bc-4fae-ba82-58ba572c562a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:09.875897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-8a3a7794-e9bc-4fae-ba82-58ba572c562a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:10.033351 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-8a3a7794-e9bc-4fae-ba82-58ba572c562a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:10.043115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-8a3a7794-e9bc-4fae-ba82-58ba572c562a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1264 microversion: 2.1 time: 0.181777 May 26 18:28:10.043718 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 473/954] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:09 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:11.063043 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-373f8e77-d516-4099-9c12-827833d03697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:11.066056 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-373f8e77-d516-4099-9c12-827833d03697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:11.073543 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-373f8e77-d516-4099-9c12-827833d03697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:11.074305 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-373f8e77-d516-4099-9c12-827833d03697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:11.075570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-373f8e77-d516-4099-9c12-827833d03697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:11.076277 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-373f8e77-d516-4099-9c12-827833d03697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:11.236361 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-373f8e77-d516-4099-9c12-827833d03697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:11.246088 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-373f8e77-d516-4099-9c12-827833d03697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1452 microversion: 2.1 time: 0.186873 May 26 18:28:11.246690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 482/955] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:11 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:11.265201 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-86a7a4ab-61d1-4d76-acb7-8d8583f36725 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:11.266038 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-86a7a4ab-61d1-4d76-acb7-8d8583f36725 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:11.272856 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-86a7a4ab-61d1-4d76-acb7-8d8583f36725 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:11.273316 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-86a7a4ab-61d1-4d76-acb7-8d8583f36725 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:11.274171 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-86a7a4ab-61d1-4d76-acb7-8d8583f36725 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:11.274614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-86a7a4ab-61d1-4d76-acb7-8d8583f36725 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:11.437363 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-86a7a4ab-61d1-4d76-acb7-8d8583f36725 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:11.447135 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-86a7a4ab-61d1-4d76-acb7-8d8583f36725 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1452 microversion: 2.1 time: 0.185981 May 26 18:28:11.447799 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 474/956] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:11 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:13.241200 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-6c791ba8-4a4c-427b-9fca-97208fff27fa req-5f5c674c-cfd4-4b5d-b03a-650946c4ed6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f76001-148d-4c5f-a8b8-a1f881a6033e", "tag": "bc0fe5cb-055f-44c6-92c5-5908d09f787b"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:28:13.250130 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6c791ba8-4a4c-427b-9fca-97208fff27fa req-5f5c674c-cfd4-4b5d-b03a-650946c4ed6e service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:13.250569 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6c791ba8-4a4c-427b-9fca-97208fff27fa req-5f5c674c-cfd4-4b5d-b03a-650946c4ed6e service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:13.262938 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-6c791ba8-4a4c-427b-9fca-97208fff27fa req-5f5c674c-cfd4-4b5d-b03a-650946c4ed6e service nova] Creating event network-changed:bc0fe5cb-055f-44c6-92c5-5908d09f787b for instance b5f76001-148d-4c5f-a8b8-a1f881a6033e on hv-cinder-84349 May 26 18:28:13.268275 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-6c791ba8-4a4c-427b-9fca-97208fff27fa req-5f5c674c-cfd4-4b5d-b03a-650946c4ed6e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030776 May 26 18:28:13.269145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 483/957] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:28:39.896563 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2d47463b-f804-4a65-9c29-94c229e526c9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:28:39.897235 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2d47463b-f804-4a65-9c29-94c229e526c9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:39.899301 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:39.899961 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=42 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:39.906969 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2d47463b-f804-4a65-9c29-94c229e526c9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:39.907428 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2d47463b-f804-4a65-9c29-94c229e526c9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:39.908212 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2d47463b-f804-4a65-9c29-94c229e526c9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:39.908652 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2d47463b-f804-4a65-9c29-94c229e526c9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:39.933642 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.objects.instance [None req-2d47463b-f804-4a65-9c29-94c229e526c9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lazy-loading 'flavor' on Instance uuid 71f6ccf2-1303-4597-98f1-7e21e99f403f {{(pid=117697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:28:40.018817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2d47463b-f804-4a65-9c29-94c229e526c9 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "POST /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f/action" status: 202 len: 0 microversion: 2.1 time: 0.126241 May 26 18:28:40.019480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 475/958] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:28:39 2022] POST /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:28:40.029960 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-7a76cad7-b02c-4237-82ca-9bc76d054413 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:40.031136 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-7a76cad7-b02c-4237-82ca-9bc76d054413 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:40.033757 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=20 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:40.034429 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=44 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:40.041131 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7a76cad7-b02c-4237-82ca-9bc76d054413 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:40.041776 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7a76cad7-b02c-4237-82ca-9bc76d054413 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:40.042771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7a76cad7-b02c-4237-82ca-9bc76d054413 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:40.043205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-7a76cad7-b02c-4237-82ca-9bc76d054413 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:40.209227 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-7a76cad7-b02c-4237-82ca-9bc76d054413 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:40.217973 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-7a76cad7-b02c-4237-82ca-9bc76d054413 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.192367 May 26 18:28:40.218573 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 484/959] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:40 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:41.241593 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-dc151c7c-9def-4e6b-87c5-e06a2fff2de0 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:41.242321 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-dc151c7c-9def-4e6b-87c5-e06a2fff2de0 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:41.249755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dc151c7c-9def-4e6b-87c5-e06a2fff2de0 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:41.250211 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dc151c7c-9def-4e6b-87c5-e06a2fff2de0 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:41.250977 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dc151c7c-9def-4e6b-87c5-e06a2fff2de0 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:41.251410 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dc151c7c-9def-4e6b-87c5-e06a2fff2de0 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:41.407048 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-dc151c7c-9def-4e6b-87c5-e06a2fff2de0 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:41.414660 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-dc151c7c-9def-4e6b-87c5-e06a2fff2de0 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.177768 May 26 18:28:41.415236 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 476/960] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:41 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:42.433088 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-24ec2abc-c443-4dda-84f3-200fc2293be5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:42.433708 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-24ec2abc-c443-4dda-84f3-200fc2293be5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:42.440384 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-24ec2abc-c443-4dda-84f3-200fc2293be5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:42.440840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-24ec2abc-c443-4dda-84f3-200fc2293be5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:42.441656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-24ec2abc-c443-4dda-84f3-200fc2293be5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:42.442165 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-24ec2abc-c443-4dda-84f3-200fc2293be5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:42.574274 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-24ec2abc-c443-4dda-84f3-200fc2293be5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:42.581722 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-24ec2abc-c443-4dda-84f3-200fc2293be5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.152889 May 26 18:28:42.582311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 485/961] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:42 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:43.651000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cdb0ba80-8f03-4fbc-9d2e-084df6521763 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:43.651653 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-cdb0ba80-8f03-4fbc-9d2e-084df6521763 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:43.658162 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cdb0ba80-8f03-4fbc-9d2e-084df6521763 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:43.658611 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cdb0ba80-8f03-4fbc-9d2e-084df6521763 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:43.659375 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cdb0ba80-8f03-4fbc-9d2e-084df6521763 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:43.659807 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cdb0ba80-8f03-4fbc-9d2e-084df6521763 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:43.794336 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-cdb0ba80-8f03-4fbc-9d2e-084df6521763 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:43.801895 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-cdb0ba80-8f03-4fbc-9d2e-084df6521763 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.155312 May 26 18:28:43.802715 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 477/962] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:43 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:44.820015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-9215f663-731f-4e54-8f14-f63237f8910a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:44.820648 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-9215f663-731f-4e54-8f14-f63237f8910a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:44.827925 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9215f663-731f-4e54-8f14-f63237f8910a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:44.828370 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9215f663-731f-4e54-8f14-f63237f8910a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:44.829135 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9215f663-731f-4e54-8f14-f63237f8910a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:44.829569 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-9215f663-731f-4e54-8f14-f63237f8910a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:44.959924 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-9215f663-731f-4e54-8f14-f63237f8910a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:44.969716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-9215f663-731f-4e54-8f14-f63237f8910a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.152337 May 26 18:28:44.969716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 486/963] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:44 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:45.985893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4748ba4f-31df-42cd-a173-4c7e91a0e737 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:45.986459 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4748ba4f-31df-42cd-a173-4c7e91a0e737 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:45.992957 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4748ba4f-31df-42cd-a173-4c7e91a0e737 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:45.993429 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4748ba4f-31df-42cd-a173-4c7e91a0e737 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:45.994804 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4748ba4f-31df-42cd-a173-4c7e91a0e737 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:45.995474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4748ba4f-31df-42cd-a173-4c7e91a0e737 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:46.127769 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4748ba4f-31df-42cd-a173-4c7e91a0e737 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:46.136320 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4748ba4f-31df-42cd-a173-4c7e91a0e737 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.154363 May 26 18:28:46.136898 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 478/964] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:45 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:47.154021 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6c5e2208-462d-4cea-bc6f-9cf6a0014494 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:47.154631 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6c5e2208-462d-4cea-bc6f-9cf6a0014494 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:47.161066 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c5e2208-462d-4cea-bc6f-9cf6a0014494 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:47.161497 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c5e2208-462d-4cea-bc6f-9cf6a0014494 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:47.162286 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c5e2208-462d-4cea-bc6f-9cf6a0014494 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:47.162720 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6c5e2208-462d-4cea-bc6f-9cf6a0014494 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:47.302053 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6c5e2208-462d-4cea-bc6f-9cf6a0014494 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:47.310039 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6c5e2208-462d-4cea-bc6f-9cf6a0014494 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.160279 May 26 18:28:47.310614 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 487/965] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:47 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:48.327514 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9844deba-2e9e-40e0-8dad-98754ff17254 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:48.328126 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9844deba-2e9e-40e0-8dad-98754ff17254 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:48.334505 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9844deba-2e9e-40e0-8dad-98754ff17254 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:48.334948 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9844deba-2e9e-40e0-8dad-98754ff17254 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:48.335704 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9844deba-2e9e-40e0-8dad-98754ff17254 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:48.336134 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9844deba-2e9e-40e0-8dad-98754ff17254 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:48.574732 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9844deba-2e9e-40e0-8dad-98754ff17254 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:48.583133 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9844deba-2e9e-40e0-8dad-98754ff17254 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.259407 May 26 18:28:48.584001 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 479/966] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:48 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:49.601085 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c8e04bac-18f4-4875-865d-08846a92efdf tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:49.601625 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c8e04bac-18f4-4875-865d-08846a92efdf tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:49.608967 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8e04bac-18f4-4875-865d-08846a92efdf tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:49.609425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8e04bac-18f4-4875-865d-08846a92efdf tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:49.610266 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8e04bac-18f4-4875-865d-08846a92efdf tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:49.610716 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c8e04bac-18f4-4875-865d-08846a92efdf tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:49.753653 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c8e04bac-18f4-4875-865d-08846a92efdf tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:49.761889 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c8e04bac-18f4-4875-865d-08846a92efdf tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.164752 May 26 18:28:49.762462 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 488/967] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:49 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:50.780327 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-15cd0f12-3041-469a-942a-bd7edc6d6be8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:50.781560 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-15cd0f12-3041-469a-942a-bd7edc6d6be8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:50.787312 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-15cd0f12-3041-469a-942a-bd7edc6d6be8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:50.787766 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-15cd0f12-3041-469a-942a-bd7edc6d6be8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:50.788544 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-15cd0f12-3041-469a-942a-bd7edc6d6be8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:50.788987 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-15cd0f12-3041-469a-942a-bd7edc6d6be8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:50.930896 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-15cd0f12-3041-469a-942a-bd7edc6d6be8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:50.939589 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-15cd0f12-3041-469a-942a-bd7edc6d6be8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.164811 May 26 18:28:50.940175 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 480/968] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:50 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:51.957624 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a801c492-cda3-401b-aa75-9e3c8d6dfbd5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:51.958265 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a801c492-cda3-401b-aa75-9e3c8d6dfbd5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:51.964792 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a801c492-cda3-401b-aa75-9e3c8d6dfbd5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:51.965239 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a801c492-cda3-401b-aa75-9e3c8d6dfbd5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:51.966030 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a801c492-cda3-401b-aa75-9e3c8d6dfbd5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:51.966464 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a801c492-cda3-401b-aa75-9e3c8d6dfbd5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:52.102958 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a801c492-cda3-401b-aa75-9e3c8d6dfbd5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:52.111133 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a801c492-cda3-401b-aa75-9e3c8d6dfbd5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.157891 May 26 18:28:52.111723 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 489/969] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:51 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:53.128589 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-82ab7ac5-0712-4bf0-9e60-202500c7a79a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:53.129177 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-82ab7ac5-0712-4bf0-9e60-202500c7a79a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:53.135906 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-82ab7ac5-0712-4bf0-9e60-202500c7a79a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:53.136348 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-82ab7ac5-0712-4bf0-9e60-202500c7a79a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:53.137114 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-82ab7ac5-0712-4bf0-9e60-202500c7a79a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:53.137545 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-82ab7ac5-0712-4bf0-9e60-202500c7a79a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:53.285440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-82ab7ac5-0712-4bf0-9e60-202500c7a79a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:53.297755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-82ab7ac5-0712-4bf0-9e60-202500c7a79a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1509 microversion: 2.1 time: 0.173102 May 26 18:28:53.298668 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 481/970] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:53 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:28:53.316397 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a284023c-3856-4161-84a4-1088426c7079 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:28:53.317530 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a284023c-3856-4161-84a4-1088426c7079 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:53.324925 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a284023c-3856-4161-84a4-1088426c7079 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:53.325460 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a284023c-3856-4161-84a4-1088426c7079 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:53.326338 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a284023c-3856-4161-84a4-1088426c7079 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:53.326861 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a284023c-3856-4161-84a4-1088426c7079 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:53.411229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a284023c-3856-4161-84a4-1088426c7079 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "POST /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f/action" status: 202 len: 0 microversion: 2.1 time: 0.099031 May 26 18:28:53.411872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 490/971] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 18:28:53 2022] POST /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:28:53.420701 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cbd164dd-5dfd-4e19-85bf-b362cd8cefa4 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:53.421433 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-cbd164dd-5dfd-4e19-85bf-b362cd8cefa4 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:53.428239 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cbd164dd-5dfd-4e19-85bf-b362cd8cefa4 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:53.428715 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cbd164dd-5dfd-4e19-85bf-b362cd8cefa4 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:53.429493 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cbd164dd-5dfd-4e19-85bf-b362cd8cefa4 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:53.429965 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cbd164dd-5dfd-4e19-85bf-b362cd8cefa4 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:53.597567 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-cbd164dd-5dfd-4e19-85bf-b362cd8cefa4 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:53.607697 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-cbd164dd-5dfd-4e19-85bf-b362cd8cefa4 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1517 microversion: 2.1 time: 0.191527 May 26 18:28:53.608267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 482/972] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:53 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:54.562968 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-a56d774c-bbb8-416d-86a2-fa40639272cc req-54ab340c-bc11-4df4-989b-121a0d200c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f6ccf2-1303-4597-98f1-7e21e99f403f", "name": "network-vif-unplugged", "status": "completed", "tag": "f47522ae-974a-4ef1-a04e-e9c179f9d917"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:28:54.580073 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-a56d774c-bbb8-416d-86a2-fa40639272cc req-54ab340c-bc11-4df4-989b-121a0d200c79 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:54.581108 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-a56d774c-bbb8-416d-86a2-fa40639272cc req-54ab340c-bc11-4df4-989b-121a0d200c79 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:54.594092 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.compute.server_external_events [req-a56d774c-bbb8-416d-86a2-fa40639272cc req-54ab340c-bc11-4df4-989b-121a0d200c79 service nova] Unable to find a host for instance 71f6ccf2-1303-4597-98f1-7e21e99f403f. Dropping event network-vif-unplugged {{(pid=117696) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 18:28:54.594950 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-a56d774c-bbb8-416d-86a2-fa40639272cc req-54ab340c-bc11-4df4-989b-121a0d200c79 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.096367 May 26 18:28:54.595595 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 491/973] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 98 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 18:28:54.626786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-4edd5f37-ee96-46d6-8abb-78b589240c3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:54.627492 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-4edd5f37-ee96-46d6-8abb-78b589240c3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:54.634152 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4edd5f37-ee96-46d6-8abb-78b589240c3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:54.634731 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4edd5f37-ee96-46d6-8abb-78b589240c3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:54.635893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4edd5f37-ee96-46d6-8abb-78b589240c3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:54.636332 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-4edd5f37-ee96-46d6-8abb-78b589240c3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:54.789280 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-4edd5f37-ee96-46d6-8abb-78b589240c3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:54.798936 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-4edd5f37-ee96-46d6-8abb-78b589240c3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1517 microversion: 2.1 time: 0.177309 May 26 18:28:54.799521 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 483/974] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:54 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:55.816595 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-51bc05fd-c1fe-4daf-850e-fa49e0425c42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:55.817313 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-51bc05fd-c1fe-4daf-850e-fa49e0425c42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:55.824528 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51bc05fd-c1fe-4daf-850e-fa49e0425c42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:55.825076 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51bc05fd-c1fe-4daf-850e-fa49e0425c42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:55.826015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51bc05fd-c1fe-4daf-850e-fa49e0425c42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:55.826550 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-51bc05fd-c1fe-4daf-850e-fa49e0425c42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:55.971425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-51bc05fd-c1fe-4daf-850e-fa49e0425c42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:55.980977 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-51bc05fd-c1fe-4daf-850e-fa49e0425c42 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1517 microversion: 2.1 time: 0.168399 May 26 18:28:55.981558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 492/975] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:55 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:56.998751 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-657be125-3f45-406a-a08c-7f96036ec97f tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:56.999361 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-657be125-3f45-406a-a08c-7f96036ec97f tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:57.006660 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-657be125-3f45-406a-a08c-7f96036ec97f tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:57.007109 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-657be125-3f45-406a-a08c-7f96036ec97f tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:57.007904 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-657be125-3f45-406a-a08c-7f96036ec97f tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:57.008327 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-657be125-3f45-406a-a08c-7f96036ec97f tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:57.166223 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-657be125-3f45-406a-a08c-7f96036ec97f tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:57.174404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-657be125-3f45-406a-a08c-7f96036ec97f tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1517 microversion: 2.1 time: 0.179888 May 26 18:28:57.174955 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 484/976] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:56 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:58.192428 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-aa733297-57ae-4782-8403-3f56f2fbce3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:58.192974 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-aa733297-57ae-4782-8403-3f56f2fbce3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:58.200160 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aa733297-57ae-4782-8403-3f56f2fbce3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:58.200619 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aa733297-57ae-4782-8403-3f56f2fbce3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:58.201398 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aa733297-57ae-4782-8403-3f56f2fbce3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:58.201871 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-aa733297-57ae-4782-8403-3f56f2fbce3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:58.335459 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-aa733297-57ae-4782-8403-3f56f2fbce3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:58.344462 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-aa733297-57ae-4782-8403-3f56f2fbce3d tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1519 microversion: 2.1 time: 0.155933 May 26 18:28:58.345170 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 493/977] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:58 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:28:59.364021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-64d144fb-511e-4a6d-bfb4-9b96e01f0fa8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:28:59.364021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-64d144fb-511e-4a6d-bfb4-9b96e01f0fa8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:28:59.370171 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-64d144fb-511e-4a6d-bfb4-9b96e01f0fa8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:59.370638 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-64d144fb-511e-4a6d-bfb4-9b96e01f0fa8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:59.371543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-64d144fb-511e-4a6d-bfb4-9b96e01f0fa8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:28:59.372027 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-64d144fb-511e-4a6d-bfb4-9b96e01f0fa8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:28:59.554163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-64d144fb-511e-4a6d-bfb4-9b96e01f0fa8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:28:59.562877 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-64d144fb-511e-4a6d-bfb4-9b96e01f0fa8 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.204370 May 26 18:28:59.563511 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 485/978] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:28:59 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:00.580521 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-54adf979-413a-4cc0-b6e0-a136d65ab998 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:00.581149 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-54adf979-413a-4cc0-b6e0-a136d65ab998 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:00.588122 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-54adf979-413a-4cc0-b6e0-a136d65ab998 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:00.588575 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-54adf979-413a-4cc0-b6e0-a136d65ab998 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:00.589353 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-54adf979-413a-4cc0-b6e0-a136d65ab998 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:00.589828 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-54adf979-413a-4cc0-b6e0-a136d65ab998 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:00.723416 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-54adf979-413a-4cc0-b6e0-a136d65ab998 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:00.731124 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-54adf979-413a-4cc0-b6e0-a136d65ab998 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.154727 May 26 18:29:00.731762 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 494/979] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:00 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:01.750192 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-7d4cf2ef-bff3-4a87-819e-b1532e525bc7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:01.750780 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-7d4cf2ef-bff3-4a87-819e-b1532e525bc7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:01.760712 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d4cf2ef-bff3-4a87-819e-b1532e525bc7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:01.761474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d4cf2ef-bff3-4a87-819e-b1532e525bc7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:01.762895 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d4cf2ef-bff3-4a87-819e-b1532e525bc7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:01.763521 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-7d4cf2ef-bff3-4a87-819e-b1532e525bc7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:01.907569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-7d4cf2ef-bff3-4a87-819e-b1532e525bc7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:01.915170 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-7d4cf2ef-bff3-4a87-819e-b1532e525bc7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.169747 May 26 18:29:01.915736 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 486/980] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:01 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:02.933222 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a0486086-28f1-4574-bc6d-6dea53f8203a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:02.933886 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a0486086-28f1-4574-bc6d-6dea53f8203a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:02.941014 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a0486086-28f1-4574-bc6d-6dea53f8203a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:02.941462 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a0486086-28f1-4574-bc6d-6dea53f8203a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:02.942258 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a0486086-28f1-4574-bc6d-6dea53f8203a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:02.942685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a0486086-28f1-4574-bc6d-6dea53f8203a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:03.072229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a0486086-28f1-4574-bc6d-6dea53f8203a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:03.080685 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a0486086-28f1-4574-bc6d-6dea53f8203a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.151394 May 26 18:29:03.081267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 495/981] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:02 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:04.098706 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-af1cb829-8289-48d0-8ded-c3dedc87f0f7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:04.099258 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-af1cb829-8289-48d0-8ded-c3dedc87f0f7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:04.105859 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af1cb829-8289-48d0-8ded-c3dedc87f0f7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:04.106311 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af1cb829-8289-48d0-8ded-c3dedc87f0f7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:04.107096 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af1cb829-8289-48d0-8ded-c3dedc87f0f7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:04.107597 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-af1cb829-8289-48d0-8ded-c3dedc87f0f7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:04.238981 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-af1cb829-8289-48d0-8ded-c3dedc87f0f7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:04.246711 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-af1cb829-8289-48d0-8ded-c3dedc87f0f7 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.151970 May 26 18:29:04.247282 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 487/982] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:04 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:05.264969 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-b2e97c39-1507-45ab-825a-b8c837fab13a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:05.265586 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-b2e97c39-1507-45ab-825a-b8c837fab13a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:05.272523 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2e97c39-1507-45ab-825a-b8c837fab13a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:05.272970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2e97c39-1507-45ab-825a-b8c837fab13a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:05.273771 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2e97c39-1507-45ab-825a-b8c837fab13a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:05.274211 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-b2e97c39-1507-45ab-825a-b8c837fab13a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:05.412547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-b2e97c39-1507-45ab-825a-b8c837fab13a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:05.420677 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-b2e97c39-1507-45ab-825a-b8c837fab13a tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.159308 May 26 18:29:05.421259 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 496/983] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:05 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:06.439416 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ea6d1ce6-33a1-4485-9c9d-159d92ee5ecc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:06.440023 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ea6d1ce6-33a1-4485-9c9d-159d92ee5ecc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:06.446633 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ea6d1ce6-33a1-4485-9c9d-159d92ee5ecc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:06.447078 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ea6d1ce6-33a1-4485-9c9d-159d92ee5ecc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:06.447834 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ea6d1ce6-33a1-4485-9c9d-159d92ee5ecc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:06.448266 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ea6d1ce6-33a1-4485-9c9d-159d92ee5ecc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:06.588094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ea6d1ce6-33a1-4485-9c9d-159d92ee5ecc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:06.595792 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ea6d1ce6-33a1-4485-9c9d-159d92ee5ecc tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.161226 May 26 18:29:06.596387 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 488/984] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:06 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:29:07.614410 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d6305d8b-136b-4350-b36e-3a70c9f64bf3 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:07.615092 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d6305d8b-136b-4350-b36e-3a70c9f64bf3 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:07.621855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6305d8b-136b-4350-b36e-3a70c9f64bf3 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:07.622311 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6305d8b-136b-4350-b36e-3a70c9f64bf3 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:07.623641 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6305d8b-136b-4350-b36e-3a70c9f64bf3 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:07.624175 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d6305d8b-136b-4350-b36e-3a70c9f64bf3 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:07.758855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d6305d8b-136b-4350-b36e-3a70c9f64bf3 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:07.767570 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d6305d8b-136b-4350-b36e-3a70c9f64bf3 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.157064 May 26 18:29:07.768168 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 497/985] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:07 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:08.785242 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a813e963-5ea1-46b8-8cd7-f98b4b111424 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:08.785889 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a813e963-5ea1-46b8-8cd7-f98b4b111424 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:08.792471 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a813e963-5ea1-46b8-8cd7-f98b4b111424 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:08.792935 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a813e963-5ea1-46b8-8cd7-f98b4b111424 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:08.793708 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a813e963-5ea1-46b8-8cd7-f98b4b111424 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:08.794190 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a813e963-5ea1-46b8-8cd7-f98b4b111424 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:08.813047 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:08.936197 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a813e963-5ea1-46b8-8cd7-f98b4b111424 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:08.944224 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a813e963-5ea1-46b8-8cd7-f98b4b111424 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.162882 May 26 18:29:08.944798 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 489/986] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:08 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:29:09.962657 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-65a27eae-5e12-48e5-aee4-eeb591e5b583 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:09.963262 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-65a27eae-5e12-48e5-aee4-eeb591e5b583 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:09.970559 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65a27eae-5e12-48e5-aee4-eeb591e5b583 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:09.971013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65a27eae-5e12-48e5-aee4-eeb591e5b583 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:09.971788 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65a27eae-5e12-48e5-aee4-eeb591e5b583 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:09.972228 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-65a27eae-5e12-48e5-aee4-eeb591e5b583 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:10.108680 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-65a27eae-5e12-48e5-aee4-eeb591e5b583 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:10.111403 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:10.117948 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-65a27eae-5e12-48e5-aee4-eeb591e5b583 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.159156 May 26 18:29:10.118537 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 498/987] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:09 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:10.637779 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-dc9083ad-3f32-484a-a4fd-8d9545dd4e8a req-74e31cea-d798-4527-94ca-da9d2f7ade33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f6ccf2-1303-4597-98f1-7e21e99f403f", "name": "network-vif-plugged", "status": "completed", "tag": "f47522ae-974a-4ef1-a04e-e9c179f9d917"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:29:10.643659 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=31 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:10.650136 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-dc9083ad-3f32-484a-a4fd-8d9545dd4e8a req-74e31cea-d798-4527-94ca-da9d2f7ade33 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:10.650614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-dc9083ad-3f32-484a-a4fd-8d9545dd4e8a req-74e31cea-d798-4527-94ca-da9d2f7ade33 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:10.664225 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-dc9083ad-3f32-484a-a4fd-8d9545dd4e8a req-74e31cea-d798-4527-94ca-da9d2f7ade33 service nova] Creating event network-vif-plugged:f47522ae-974a-4ef1-a04e-e9c179f9d917 for instance 71f6ccf2-1303-4597-98f1-7e21e99f403f on hv-cinder-84349 May 26 18:29:10.669543 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-dc9083ad-3f32-484a-a4fd-8d9545dd4e8a req-74e31cea-d798-4527-94ca-da9d2f7ade33 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036007 May 26 18:29:10.670189 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 490/988] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:29:11.135744 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-30b54095-bfba-4652-8376-b7311ccc3f58 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:11.136360 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-30b54095-bfba-4652-8376-b7311ccc3f58 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:11.139326 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=33 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:11.146433 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-30b54095-bfba-4652-8376-b7311ccc3f58 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:11.146888 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-30b54095-bfba-4652-8376-b7311ccc3f58 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:11.147695 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-30b54095-bfba-4652-8376-b7311ccc3f58 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:11.148145 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-30b54095-bfba-4652-8376-b7311ccc3f58 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:11.281620 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-30b54095-bfba-4652-8376-b7311ccc3f58 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:11.289334 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-30b54095-bfba-4652-8376-b7311ccc3f58 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1575 microversion: 2.1 time: 0.157463 May 26 18:29:11.289925 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 499/989] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:11 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:29:12.308123 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c0762c7b-b3a9-4a32-93ec-9575ffa2ed91 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:29:12.308819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c0762c7b-b3a9-4a32-93ec-9575ffa2ed91 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:29:12.315192 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c0762c7b-b3a9-4a32-93ec-9575ffa2ed91 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:12.315641 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c0762c7b-b3a9-4a32-93ec-9575ffa2ed91 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:12.316412 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c0762c7b-b3a9-4a32-93ec-9575ffa2ed91 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:29:12.316846 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c0762c7b-b3a9-4a32-93ec-9575ffa2ed91 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:29:12.452930 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c0762c7b-b3a9-4a32-93ec-9575ffa2ed91 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:29:12.461516 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c0762c7b-b3a9-4a32-93ec-9575ffa2ed91 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1562 microversion: 2.1 time: 0.158258 May 26 18:29:12.462115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 491/990] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:29:12 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:07.664269 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-98a90c71-7e0a-47e2-aa1a-b6032ec1d1f2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:07.664891 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-98a90c71-7e0a-47e2-aa1a-b6032ec1d1f2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:07.666783 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:07.667428 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=7 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:07.673298 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-98a90c71-7e0a-47e2-aa1a-b6032ec1d1f2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:07.673764 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-98a90c71-7e0a-47e2-aa1a-b6032ec1d1f2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:07.674528 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-98a90c71-7e0a-47e2-aa1a-b6032ec1d1f2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:07.674962 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-98a90c71-7e0a-47e2-aa1a-b6032ec1d1f2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:07.701017 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-98a90c71-7e0a-47e2-aa1a-b6032ec1d1f2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:30:07.791877 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-98a90c71-7e0a-47e2-aa1a-b6032ec1d1f2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 204 len: 0 microversion: 2.1 time: 0.130217 May 26 18:30:07.792772 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 500/991] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:30:07 2022] DELETE /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:30:07.801117 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-92a8e1df-cdb7-4da8-bde0-993351ec3af9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:07.801755 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-92a8e1df-cdb7-4da8-bde0-993351ec3af9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:07.804666 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:07.805571 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=10 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:07.811289 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-92a8e1df-cdb7-4da8-bde0-993351ec3af9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:07.811740 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-92a8e1df-cdb7-4da8-bde0-993351ec3af9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:07.812507 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-92a8e1df-cdb7-4da8-bde0-993351ec3af9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:07.812940 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-92a8e1df-cdb7-4da8-bde0-993351ec3af9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:07.950884 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-92a8e1df-cdb7-4da8-bde0-993351ec3af9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:07.959598 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-92a8e1df-cdb7-4da8-bde0-993351ec3af9 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1577 microversion: 2.1 time: 0.162444 May 26 18:30:07.960819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 492/992] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:07 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:08.979267 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c9ffe45a-5480-4ce9-ba7a-1d9b5cc57c60 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:08.979959 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c9ffe45a-5480-4ce9-ba7a-1d9b5cc57c60 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:08.986737 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9ffe45a-5480-4ce9-ba7a-1d9b5cc57c60 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:08.987185 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9ffe45a-5480-4ce9-ba7a-1d9b5cc57c60 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:08.987940 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9ffe45a-5480-4ce9-ba7a-1d9b5cc57c60 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:08.988372 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c9ffe45a-5480-4ce9-ba7a-1d9b5cc57c60 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:09.122054 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-c9ffe45a-5480-4ce9-ba7a-1d9b5cc57c60 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:09.129689 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c9ffe45a-5480-4ce9-ba7a-1d9b5cc57c60 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1577 microversion: 2.1 time: 0.155691 May 26 18:30:09.130282 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 501/993] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:08 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:10.148462 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-61d906ab-24cd-49ab-b233-c6ccc972bb81 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:10.149554 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-61d906ab-24cd-49ab-b233-c6ccc972bb81 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:10.158151 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-61d906ab-24cd-49ab-b233-c6ccc972bb81 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:10.158657 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-61d906ab-24cd-49ab-b233-c6ccc972bb81 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:10.159600 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-61d906ab-24cd-49ab-b233-c6ccc972bb81 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:10.160040 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-61d906ab-24cd-49ab-b233-c6ccc972bb81 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:10.312817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-61d906ab-24cd-49ab-b233-c6ccc972bb81 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:10.321897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-61d906ab-24cd-49ab-b233-c6ccc972bb81 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 200 len: 1510 microversion: 2.1 time: 0.178131 May 26 18:30:10.322705 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 493/994] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:10 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:10.501661 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-f957055d-3db1-43aa-982e-6699a5ebba53 req-c853d072-6228-4ddc-a815-1b3478dcb742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f76001-148d-4c5f-a8b8-a1f881a6033e", "name": "network-vif-deleted", "tag": "bc0fe5cb-055f-44c6-92c5-5908d09f787b"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:30:10.511441 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-f957055d-3db1-43aa-982e-6699a5ebba53 req-c853d072-6228-4ddc-a815-1b3478dcb742 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:10.511882 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-f957055d-3db1-43aa-982e-6699a5ebba53 req-c853d072-6228-4ddc-a815-1b3478dcb742 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:10.524205 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-f957055d-3db1-43aa-982e-6699a5ebba53 req-c853d072-6228-4ddc-a815-1b3478dcb742 service nova] Creating event network-vif-deleted:bc0fe5cb-055f-44c6-92c5-5908d09f787b for instance b5f76001-148d-4c5f-a8b8-a1f881a6033e on hv-cinder-84349 May 26 18:30:10.530071 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-f957055d-3db1-43aa-982e-6699a5ebba53 req-c853d072-6228-4ddc-a815-1b3478dcb742 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155207 May 26 18:30:10.530642 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 502/995] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:30:11.339222 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:11.339942 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:11.346771 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:11.347235 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:11.348021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:11.348478 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:11.364120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] HTTP exception thrown: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Request method failure captured: May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e HTTP/1.1 May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8aUFrkHgrRh10SKb5gITkEKEuCcayjpgBgph1zzn_8s-WC6Lya6kwZ3NxMSWWqDDiUOBD65TFj_nKjRSv9at-v4mdAoPKKwSicvhREZtQEf_f97I-345GdNM5Vo7r_sW0-xmg0Y1TqAqL33wa_F99kIZ61wmlzXthdNgi1UcWKohow May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:30:11.365817 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6774c3ce4b094e19ad6da95e3744d9ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-TestVolumeBootPattern-527529841 May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-TestVolumeBootPattern-527529841-project May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 7cde3488be6c4c8790841b7529123326 May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-TestVolumeBootPattern-527529841-project May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:30:11.368265 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'b5f76001-148d-4c5f-a8b8-a1f881a6033e'} May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:30:11.369166 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:30:11.370518 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:11.371802 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Returning 404 to user: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:30:11.371802 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-3dbf8cb7-34f9-4583-b5de-136e4b42288a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 404 len: 111 microversion: 2.1 time: 0.032929 May 26 18:30:11.371802 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 494/996] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:11 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:30:11.416562 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-907545777", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2004287902", "security_groups": [{"name": "tempest-secgroup-smoke-981813776"}], "block_device_mapping_v2": [{"uuid": "5c4c016c-e812-4606-95e0-a93a54af3acf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b8a2aca-5692-49b8-9e87-22b18005ff6f"}]}} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:30:11.541302 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.network.neutron [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] validate_networks() for [('6b8a2aca-5692-49b8-9e87-22b18005ff6f', None, None, None, None, None)] {{(pid=117696) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:30:11.989475 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Flavor limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:30:11.989946 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Image limits 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:30:11.990445 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Flavor pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:30:11.990848 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Image pref 0:0:0 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:30:11.991870 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.virt.hardware [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:30:12.001663 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:12.002173 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:12.003013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:12.003455 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:12.020189 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Getting quotas for project 6774c3ce4b094e19ad6da95e3744d9ed. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:30:12.024568 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.quota [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Getting quotas for user 7cde3488be6c4c8790841b7529123326 and project 6774c3ce4b094e19ad6da95e3744d9ed. Resources: {'ram', 'cores', 'instances'} {{(pid=117696) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:30:12.083938 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Going to run 1 instances... {{(pid=117696) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:30:12.086777 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c4c016c-e812-4606-95e0-a93a54af3acf',volume_size=None,volume_type=None)] {{(pid=117696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:30:12.217199 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-58d64caf-b162-4c91-8572-f62b2c375ca7 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805454 May 26 18:30:12.217872 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 503/997] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:30:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:30:12.228508 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a1f03ce3-fe23-4240-86a2-6ade15cadc11 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:12.229122 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a1f03ce3-fe23-4240-86a2-6ade15cadc11 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:12.283892 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a1f03ce3-fe23-4240-86a2-6ade15cadc11 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:12.291636 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a1f03ce3-fe23-4240-86a2-6ade15cadc11 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1094 microversion: 2.1 time: 0.067631 May 26 18:30:12.292118 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 495/998] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:12 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:13.309202 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-e5c6ad95-5586-47a9-afb6-5526a02188cb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:13.310363 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-e5c6ad95-5586-47a9-afb6-5526a02188cb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:13.321104 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad95-5586-47a9-afb6-5526a02188cb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:13.321932 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad95-5586-47a9-afb6-5526a02188cb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:13.322822 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad95-5586-47a9-afb6-5526a02188cb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:13.323672 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-e5c6ad95-5586-47a9-afb6-5526a02188cb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:13.412444 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-e5c6ad95-5586-47a9-afb6-5526a02188cb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:13.421768 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-e5c6ad95-5586-47a9-afb6-5526a02188cb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1210 microversion: 2.1 time: 0.116904 May 26 18:30:13.422388 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 504/999] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:13 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:14.442806 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0eb0924b-0fcd-473c-98ef-0f24bd438990 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:14.444094 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-0eb0924b-0fcd-473c-98ef-0f24bd438990 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:14.451220 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0eb0924b-0fcd-473c-98ef-0f24bd438990 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:14.451925 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0eb0924b-0fcd-473c-98ef-0f24bd438990 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:14.452880 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0eb0924b-0fcd-473c-98ef-0f24bd438990 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:14.453477 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-0eb0924b-0fcd-473c-98ef-0f24bd438990 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:14.726799 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-0eb0924b-0fcd-473c-98ef-0f24bd438990 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:14.736882 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0eb0924b-0fcd-473c-98ef-0f24bd438990 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.298778 May 26 18:30:14.737666 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 496/1000] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:14 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:14.752558 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-6c2899de-612b-40cd-adb1-94cc8d5aa68a req-23ab53f1-c4de-438a-96ae-1f5a23becd25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22", "tag": "d90b241f-7d62-419a-b730-21988dd581c7"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:30:14.773016 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6c2899de-612b-40cd-adb1-94cc8d5aa68a req-23ab53f1-c4de-438a-96ae-1f5a23becd25 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:14.773489 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6c2899de-612b-40cd-adb1-94cc8d5aa68a req-23ab53f1-c4de-438a-96ae-1f5a23becd25 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:14.785466 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-6c2899de-612b-40cd-adb1-94cc8d5aa68a req-23ab53f1-c4de-438a-96ae-1f5a23becd25 service nova] Creating event network-changed:d90b241f-7d62-419a-b730-21988dd581c7 for instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 on hv-cinder-84349 May 26 18:30:14.791223 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-6c2899de-612b-40cd-adb1-94cc8d5aa68a req-23ab53f1-c4de-438a-96ae-1f5a23becd25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043756 May 26 18:30:14.793900 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 505/1001] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:30:15.760617 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-de07eb53-0d75-4c2d-85ee-474c8e317fab tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:15.761236 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-de07eb53-0d75-4c2d-85ee-474c8e317fab tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:15.768030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de07eb53-0d75-4c2d-85ee-474c8e317fab tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:15.768494 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de07eb53-0d75-4c2d-85ee-474c8e317fab tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:15.769267 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de07eb53-0d75-4c2d-85ee-474c8e317fab tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:15.769712 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-de07eb53-0d75-4c2d-85ee-474c8e317fab tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:15.936806 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-de07eb53-0d75-4c2d-85ee-474c8e317fab tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:15.944285 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-de07eb53-0d75-4c2d-85ee-474c8e317fab tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.187794 May 26 18:30:15.945043 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 497/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:15 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:16.962476 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-6e702e77-b7ba-4fda-a380-6405b7a1be75 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:16.963170 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-6e702e77-b7ba-4fda-a380-6405b7a1be75 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:16.969368 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e702e77-b7ba-4fda-a380-6405b7a1be75 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:16.969849 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e702e77-b7ba-4fda-a380-6405b7a1be75 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:16.970607 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e702e77-b7ba-4fda-a380-6405b7a1be75 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:16.971043 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-6e702e77-b7ba-4fda-a380-6405b7a1be75 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:17.110855 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-6e702e77-b7ba-4fda-a380-6405b7a1be75 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:17.119302 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-6e702e77-b7ba-4fda-a380-6405b7a1be75 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.162527 May 26 18:30:17.119882 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 506/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:16 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:18.136538 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2955f6b0-f9c6-4504-adba-89980efd571c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:18.137155 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2955f6b0-f9c6-4504-adba-89980efd571c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:18.143808 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2955f6b0-f9c6-4504-adba-89980efd571c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:18.144262 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2955f6b0-f9c6-4504-adba-89980efd571c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:18.145030 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2955f6b0-f9c6-4504-adba-89980efd571c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:18.145474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2955f6b0-f9c6-4504-adba-89980efd571c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:18.280574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2955f6b0-f9c6-4504-adba-89980efd571c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:18.289303 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2955f6b0-f9c6-4504-adba-89980efd571c tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.156460 May 26 18:30:18.289908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 498/1004] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:18 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:19.306910 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fdc66bb6-555a-4ef7-a898-b0f80156c9e4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:19.307518 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fdc66bb6-555a-4ef7-a898-b0f80156c9e4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:19.314020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fdc66bb6-555a-4ef7-a898-b0f80156c9e4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:19.314477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fdc66bb6-555a-4ef7-a898-b0f80156c9e4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:19.315243 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fdc66bb6-555a-4ef7-a898-b0f80156c9e4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:19.315678 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fdc66bb6-555a-4ef7-a898-b0f80156c9e4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:19.445272 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fdc66bb6-555a-4ef7-a898-b0f80156c9e4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:19.452751 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fdc66bb6-555a-4ef7-a898-b0f80156c9e4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.150715 May 26 18:30:19.453330 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 507/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:19 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:20.468815 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-91b7ed5c-2853-49df-b490-85f09de53032 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:20.469441 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-91b7ed5c-2853-49df-b490-85f09de53032 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:20.476844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-91b7ed5c-2853-49df-b490-85f09de53032 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:20.477313 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-91b7ed5c-2853-49df-b490-85f09de53032 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:20.478110 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-91b7ed5c-2853-49df-b490-85f09de53032 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:20.478550 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-91b7ed5c-2853-49df-b490-85f09de53032 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:20.610399 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-91b7ed5c-2853-49df-b490-85f09de53032 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:20.618646 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-91b7ed5c-2853-49df-b490-85f09de53032 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.153737 May 26 18:30:20.619619 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 499/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:20 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:21.636242 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-82b40ce7-fa97-4b19-b830-528e54dd821d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:21.636794 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-82b40ce7-fa97-4b19-b830-528e54dd821d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:21.644561 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82b40ce7-fa97-4b19-b830-528e54dd821d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:21.645081 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82b40ce7-fa97-4b19-b830-528e54dd821d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:21.646107 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82b40ce7-fa97-4b19-b830-528e54dd821d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:21.646559 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-82b40ce7-fa97-4b19-b830-528e54dd821d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:21.794835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-82b40ce7-fa97-4b19-b830-528e54dd821d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:21.803081 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-82b40ce7-fa97-4b19-b830-528e54dd821d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.170886 May 26 18:30:21.803862 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 508/1007] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:21 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:22.820981 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-ff9514ab-be16-42a8-8581-993f69df9917 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:22.821599 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-ff9514ab-be16-42a8-8581-993f69df9917 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:22.823951 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:22.829421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ff9514ab-be16-42a8-8581-993f69df9917 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:22.830402 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ff9514ab-be16-42a8-8581-993f69df9917 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:22.830880 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ff9514ab-be16-42a8-8581-993f69df9917 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:22.831511 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-ff9514ab-be16-42a8-8581-993f69df9917 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:22.969180 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-ff9514ab-be16-42a8-8581-993f69df9917 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:22.977573 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-ff9514ab-be16-42a8-8581-993f69df9917 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.161609 May 26 18:30:22.978187 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 500/1008] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:22 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:23.995238 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-315096e3-2c8b-4e86-9bf7-1fe744e514d3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:23.995880 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-315096e3-2c8b-4e86-9bf7-1fe744e514d3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:23.997796 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:23.998446 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=6 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:24.004539 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-315096e3-2c8b-4e86-9bf7-1fe744e514d3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:24.004984 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-315096e3-2c8b-4e86-9bf7-1fe744e514d3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:24.005766 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-315096e3-2c8b-4e86-9bf7-1fe744e514d3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:24.006226 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-315096e3-2c8b-4e86-9bf7-1fe744e514d3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:24.139064 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-315096e3-2c8b-4e86-9bf7-1fe744e514d3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:24.146497 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-315096e3-2c8b-4e86-9bf7-1fe744e514d3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.156082 May 26 18:30:24.147586 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 509/1009] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:23 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:24.915258 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-89770cb4-6530-4299-b29f-1ec8c00a4cd7 req-e7a88751-70a1-43e6-95dc-78e8bc9775b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22", "name": "network-vif-plugged", "status": "completed", "tag": "d90b241f-7d62-419a-b730-21988dd581c7"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:30:24.924796 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-89770cb4-6530-4299-b29f-1ec8c00a4cd7 req-e7a88751-70a1-43e6-95dc-78e8bc9775b9 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:24.925312 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-89770cb4-6530-4299-b29f-1ec8c00a4cd7 req-e7a88751-70a1-43e6-95dc-78e8bc9775b9 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:24.939800 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-89770cb4-6530-4299-b29f-1ec8c00a4cd7 req-e7a88751-70a1-43e6-95dc-78e8bc9775b9 service nova] Creating event network-vif-plugged:d90b241f-7d62-419a-b730-21988dd581c7 for instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 on hv-cinder-84349 May 26 18:30:24.945577 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-89770cb4-6530-4299-b29f-1ec8c00a4cd7 req-e7a88751-70a1-43e6-95dc-78e8bc9775b9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035247 May 26 18:30:24.946273 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 501/1010] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:30:25.167365 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3b19bcef-5d93-4df1-99cf-4c0c58a61c44 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:25.168285 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3b19bcef-5d93-4df1-99cf-4c0c58a61c44 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:25.178817 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3b19bcef-5d93-4df1-99cf-4c0c58a61c44 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:25.179970 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3b19bcef-5d93-4df1-99cf-4c0c58a61c44 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:25.180850 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3b19bcef-5d93-4df1-99cf-4c0c58a61c44 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:25.181442 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3b19bcef-5d93-4df1-99cf-4c0c58a61c44 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:25.344835 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3b19bcef-5d93-4df1-99cf-4c0c58a61c44 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:25.353157 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3b19bcef-5d93-4df1-99cf-4c0c58a61c44 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1265 microversion: 2.1 time: 0.191843 May 26 18:30:25.353780 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 510/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:25 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:26.371537 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-54b15436-5564-4dc0-bbe0-f91d8d7b2733 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:26.372349 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-54b15436-5564-4dc0-bbe0-f91d8d7b2733 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:26.378788 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54b15436-5564-4dc0-bbe0-f91d8d7b2733 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:26.379227 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54b15436-5564-4dc0-bbe0-f91d8d7b2733 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:26.379996 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54b15436-5564-4dc0-bbe0-f91d8d7b2733 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:26.380455 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-54b15436-5564-4dc0-bbe0-f91d8d7b2733 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:26.538748 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-54b15436-5564-4dc0-bbe0-f91d8d7b2733 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:26.547436 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-54b15436-5564-4dc0-bbe0-f91d8d7b2733 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1452 microversion: 2.1 time: 0.179824 May 26 18:30:26.548676 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 502/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:26 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:26.565235 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-fc2f020a-ce84-44bc-89de-ff55bc7900f8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:26.566236 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-fc2f020a-ce84-44bc-89de-ff55bc7900f8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:26.572804 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc2f020a-ce84-44bc-89de-ff55bc7900f8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:26.573263 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc2f020a-ce84-44bc-89de-ff55bc7900f8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:26.574089 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc2f020a-ce84-44bc-89de-ff55bc7900f8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:26.574456 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-fc2f020a-ce84-44bc-89de-ff55bc7900f8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:26.715665 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-fc2f020a-ce84-44bc-89de-ff55bc7900f8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:26.725656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-fc2f020a-ce84-44bc-89de-ff55bc7900f8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1452 microversion: 2.1 time: 0.164704 May 26 18:30:26.726526 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 511/1013] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:26 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:30:28.626232 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-ffda4770-b7f1-486e-90ba-dcc97f4cdb2e req-33246ece-e47a-4e1f-96d9-1490061bfa09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22", "tag": "d90b241f-7d62-419a-b730-21988dd581c7"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:30:28.636712 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ffda4770-b7f1-486e-90ba-dcc97f4cdb2e req-33246ece-e47a-4e1f-96d9-1490061bfa09 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:28.637273 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-ffda4770-b7f1-486e-90ba-dcc97f4cdb2e req-33246ece-e47a-4e1f-96d9-1490061bfa09 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:28.650392 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-ffda4770-b7f1-486e-90ba-dcc97f4cdb2e req-33246ece-e47a-4e1f-96d9-1490061bfa09 service nova] Creating event network-changed:d90b241f-7d62-419a-b730-21988dd581c7 for instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 on hv-cinder-84349 May 26 18:30:28.656255 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-ffda4770-b7f1-486e-90ba-dcc97f4cdb2e req-33246ece-e47a-4e1f-96d9-1490061bfa09 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033344 May 26 18:30:28.656983 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 503/1014] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:30:28.922525 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-bbae2a31-859b-459e-b42b-45b5cc851de5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:28.923099 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bbae2a31-859b-459e-b42b-45b5cc851de5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:28.931124 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-a4287530-7818-402e-9bcb-8d201c507f17 req-1c22f7b6-bb8f-4424-ad69-96eaed5147cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f6ccf2-1303-4597-98f1-7e21e99f403f", "tag": "f47522ae-974a-4ef1-a04e-e9c179f9d917"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:30:28.934101 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bbae2a31-859b-459e-b42b-45b5cc851de5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:28.934749 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bbae2a31-859b-459e-b42b-45b5cc851de5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:28.935690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bbae2a31-859b-459e-b42b-45b5cc851de5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:28.936407 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-bbae2a31-859b-459e-b42b-45b5cc851de5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:28.947115 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a4287530-7818-402e-9bcb-8d201c507f17 req-1c22f7b6-bb8f-4424-ad69-96eaed5147cc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:28.947568 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-a4287530-7818-402e-9bcb-8d201c507f17 req-1c22f7b6-bb8f-4424-ad69-96eaed5147cc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:28.968607 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-a4287530-7818-402e-9bcb-8d201c507f17 req-1c22f7b6-bb8f-4424-ad69-96eaed5147cc service nova] Creating event network-changed:f47522ae-974a-4ef1-a04e-e9c179f9d917 for instance 71f6ccf2-1303-4597-98f1-7e21e99f403f on hv-cinder-84349 May 26 18:30:28.973483 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-bbae2a31-859b-459e-b42b-45b5cc851de5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:30:28.973786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-a4287530-7818-402e-9bcb-8d201c507f17 req-1c22f7b6-bb8f-4424-ad69-96eaed5147cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048511 May 26 18:30:28.974404 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 504/1015] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:30:29.086455 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-bbae2a31-859b-459e-b42b-45b5cc851de5 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "DELETE /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 204 len: 0 microversion: 2.1 time: 0.163950 May 26 18:30:29.087754 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 512/1016] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:30:28 2022] DELETE /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:30:29.102103 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d1351c45-ab3d-4419-a165-3c6395939485 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:29.103052 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d1351c45-ab3d-4419-a165-3c6395939485 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:29.110553 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d1351c45-ab3d-4419-a165-3c6395939485 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:29.111011 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d1351c45-ab3d-4419-a165-3c6395939485 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:29.111793 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d1351c45-ab3d-4419-a165-3c6395939485 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:29.112421 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d1351c45-ab3d-4419-a165-3c6395939485 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:29.266378 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-d1351c45-ab3d-4419-a165-3c6395939485 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:29.274480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d1351c45-ab3d-4419-a165-3c6395939485 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.180976 May 26 18:30:29.275367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 505/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:29 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:30:30.294091 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-d88f8905-8285-4796-b712-e2f576948831 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:30.295015 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-d88f8905-8285-4796-b712-e2f576948831 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:30.303283 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d88f8905-8285-4796-b712-e2f576948831 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:30.304224 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d88f8905-8285-4796-b712-e2f576948831 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:30.305049 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d88f8905-8285-4796-b712-e2f576948831 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:30.305487 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-d88f8905-8285-4796-b712-e2f576948831 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:30.572375 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-d88f8905-8285-4796-b712-e2f576948831 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:30.580327 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-d88f8905-8285-4796-b712-e2f576948831 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1568 microversion: 2.1 time: 0.291183 May 26 18:30:30.580906 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 513/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:30 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:30:31.181038 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-f66f7a0f-7503-4b60-b283-a0aa0072c8ac req-200b3f85-b070-4c5b-89d6-d806cfaa898f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f6ccf2-1303-4597-98f1-7e21e99f403f", "name": "network-vif-deleted", "tag": "f47522ae-974a-4ef1-a04e-e9c179f9d917"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:30:31.191418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-f66f7a0f-7503-4b60-b283-a0aa0072c8ac req-200b3f85-b070-4c5b-89d6-d806cfaa898f service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:31.191871 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-f66f7a0f-7503-4b60-b283-a0aa0072c8ac req-200b3f85-b070-4c5b-89d6-d806cfaa898f service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:31.204897 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-f66f7a0f-7503-4b60-b283-a0aa0072c8ac req-200b3f85-b070-4c5b-89d6-d806cfaa898f service nova] Creating event network-vif-deleted:f47522ae-974a-4ef1-a04e-e9c179f9d917 for instance 71f6ccf2-1303-4597-98f1-7e21e99f403f on hv-cinder-84349 May 26 18:30:31.212693 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-f66f7a0f-7503-4b60-b283-a0aa0072c8ac req-200b3f85-b070-4c5b-89d6-d806cfaa898f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035951 May 26 18:30:31.213400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 506/1019] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:30:31.598978 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:31.599869 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:31.607377 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:31.607917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:31.608582 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:31.609013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:31.643288 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:31.643690 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:31.644209 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.objects.instance [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lazy-loading 'fault' on Instance uuid 71f6ccf2-1303-4597-98f1-7e21e99f403f {{(pid=117696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:30:31.689308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73559b7886614dd2a92e9c6c53307331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564690a570ea4ec199dc599d288756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:30:31.695163 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:31.700692 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f923bf59-ece2-4d7c-bed5-9b0f168df5c2 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 200 len: 1225 microversion: 2.1 time: 0.105886 May 26 18:30:31.701218 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 514/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:31 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:30:32.719113 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:32.719819 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] [instance: 71f6ccf2-1303-4597-98f1-7e21e99f403f] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:30:32.727906 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:32.728405 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:32.729256 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:30:32.729717 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:30:32.745022 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] HTTP exception thrown: Instance 71f6ccf2-1303-4597-98f1-7e21e99f403f could not be found. May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Request method failure captured: May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f HTTP/1.1 May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8Y4l7pE_zSZ8KTfjhqqxxerQkSNHml0av6rNBNGzrSOI3fPqpkZZWkcftklWwv2M29BNfaXoCA9fDP9kBv19KZKDdGubaAG1FDfsbl_C9B9nwgc0FS1wynRehSqfOTIAYrpr-v76Xf1-UsRyb30m12s7sgAr7obVdPHyvPjO-D9f2E May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 564690a570ea4ec199dc599d288756b0 May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-TestShelveInstance-814571668 May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:30:32.747073 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/564690a570ea4ec199dc599d288756b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/564690a570ea4ec199dc599d288756b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/564690a570ea4ec199dc599d288756b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_564690a570ea4ec199dc599d288756b0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-TestShelveInstance-814571668 May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 564690a570ea4ec199dc599d288756b0 May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-TestShelveInstance-814571668 May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-TestShelveInstance-814571668-project May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 73559b7886614dd2a92e9c6c53307331 May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-TestShelveInstance-814571668-project May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 71f6ccf2-1303-4597-98f1-7e21e99f403f could not be found. May 26 18:30:32.749268 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '71f6ccf2-1303-4597-98f1-7e21e99f403f'} May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f6ccf2-1303-4597-98f1-7e21e99f403f could not be found. May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:30:32.750418 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f6ccf2-1303-4597-98f1-7e21e99f403f could not be found. May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f6ccf2-1303-4597-98f1-7e21e99f403f could not be found. May 26 18:30:32.752207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:30:32.753688 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Returning 404 to user: Instance 71f6ccf2-1303-4597-98f1-7e21e99f403f could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:30:32.753688 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-cf60c914-9e57-4621-9ec3-efd526de61fd tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f" status: 404 len: 111 microversion: 2.1 time: 0.034364 May 26 18:30:32.753688 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 507/1021] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:30:32 2022] GET /compute/v2.1/servers/71f6ccf2-1303-4597-98f1-7e21e99f403f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:30:32.917807 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-372140fb-00e3-4e37-acb7-9d93fc1768f1 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] Calling method '.version_select at 0x7f5f187121f0>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:30:32.940061 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-372140fb-00e3-4e37-acb7-9d93fc1768f1 tempest-TestShelveInstance-814571668 tempest-TestShelveInstance-814571668-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1204774411" status: 202 len: 0 microversion: 2.1 time: 0.024837 May 26 18:30:32.940717 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 515/1022] 10.222.0.46 () {58 vars in 1253 bytes} [Thu May 26 18:30:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1204774411 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:31:04.396056 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:31:04.396607 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Thu May 26 18:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:31:10.486091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:31:10.487147 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Thu May 26 18:31:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:32:05.050746 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=34 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:05.051490 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=66 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:05.056125 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-566931563", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2004287902", "security_groups": [{"name": "tempest-secgroup-smoke-981813776"}], "block_device_mapping_v2": [{"uuid": "ed3939c7-b5ea-4c34-a5f2-84b055af8541", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b8a2aca-5692-49b8-9e87-22b18005ff6f"}]}} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:32:05.174490 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.network.neutron [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] validate_networks() for [('6b8a2aca-5692-49b8-9e87-22b18005ff6f', None, None, None, None, None)] {{(pid=117697) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:32:05.539619 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Flavor limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:32:05.540041 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Image limits 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:32:05.540514 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Flavor pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:32:05.540923 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Image pref 0:0:0 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:32:05.541528 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.virt.hardware [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:32:05.550787 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:05.551252 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:05.552056 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:05.552498 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:05.570193 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Getting quotas for project 6774c3ce4b094e19ad6da95e3744d9ed. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:32:05.574282 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.quota [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Getting quotas for user 7cde3488be6c4c8790841b7529123326 and project 6774c3ce4b094e19ad6da95e3744d9ed. Resources: {'ram', 'cores', 'instances'} {{(pid=117697) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:32:05.634844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Going to run 1 instances... {{(pid=117697) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:32:05.636975 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed3939c7-b5ea-4c34-a5f2-84b055af8541',volume_size=None,volume_type=None)] {{(pid=117697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:32:05.765604 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-d13e8fd4-5928-42ec-b0f8-dfc5e948c9fb tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716490 May 26 18:32:05.766301 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 508/1023] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 18:32:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:32:05.775426 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:05.781596 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-93351b39-f41f-4d56-9f41-50b8e6a93e84 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:05.782249 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-93351b39-f41f-4d56-9f41-50b8e6a93e84 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:05.839857 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-93351b39-f41f-4d56-9f41-50b8e6a93e84 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:05.847410 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-93351b39-f41f-4d56-9f41-50b8e6a93e84 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1094 microversion: 2.1 time: 0.075155 May 26 18:32:05.847969 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 516/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:05 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:06.865103 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2e49519f-5305-4fbc-9ac0-6a88117554f4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:06.865716 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2e49519f-5305-4fbc-9ac0-6a88117554f4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:06.872330 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2e49519f-5305-4fbc-9ac0-6a88117554f4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:06.872789 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2e49519f-5305-4fbc-9ac0-6a88117554f4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:06.873584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2e49519f-5305-4fbc-9ac0-6a88117554f4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:06.874071 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2e49519f-5305-4fbc-9ac0-6a88117554f4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:06.953783 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2e49519f-5305-4fbc-9ac0-6a88117554f4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:06.962935 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2e49519f-5305-4fbc-9ac0-6a88117554f4 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1210 microversion: 2.1 time: 0.102312 May 26 18:32:06.963526 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 509/1025] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:06 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:07.981253 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-f447d2cd-fc78-4ee5-8ef4-6116769b857d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:07.982182 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-f447d2cd-fc78-4ee5-8ef4-6116769b857d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:07.988830 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f447d2cd-fc78-4ee5-8ef4-6116769b857d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:07.989283 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f447d2cd-fc78-4ee5-8ef4-6116769b857d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:07.990090 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f447d2cd-fc78-4ee5-8ef4-6116769b857d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:07.990528 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-f447d2cd-fc78-4ee5-8ef4-6116769b857d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:08.109277 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-b76d426a-47ee-4758-bc48-1a92652d372e req-1a3a6a37-d096-414b-a06b-1d5bd2e25521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359aeef4-2b65-4763-984b-ac8d32ea303e", "tag": "62721df7-b6e4-44fe-9d31-491e9808235d"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:32:08.119440 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-b76d426a-47ee-4758-bc48-1a92652d372e req-1a3a6a37-d096-414b-a06b-1d5bd2e25521 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:08.119912 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-b76d426a-47ee-4758-bc48-1a92652d372e req-1a3a6a37-d096-414b-a06b-1d5bd2e25521 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:08.136403 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-b76d426a-47ee-4758-bc48-1a92652d372e req-1a3a6a37-d096-414b-a06b-1d5bd2e25521 service nova] Creating event network-changed:62721df7-b6e4-44fe-9d31-491e9808235d for instance 359aeef4-2b65-4763-984b-ac8d32ea303e on hv-cinder-84349 May 26 18:32:08.141821 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-b76d426a-47ee-4758-bc48-1a92652d372e req-1a3a6a37-d096-414b-a06b-1d5bd2e25521 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039231 May 26 18:32:08.142504 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 510/1026] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:32:08.262422 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-f447d2cd-fc78-4ee5-8ef4-6116769b857d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:08.270038 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-f447d2cd-fc78-4ee5-8ef4-6116769b857d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.292796 May 26 18:32:08.270614 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 517/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:07 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:09.288662 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a66602f6-c112-4e55-b723-016e170b24c3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:09.289364 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a66602f6-c112-4e55-b723-016e170b24c3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:09.295741 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a66602f6-c112-4e55-b723-016e170b24c3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:09.296200 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a66602f6-c112-4e55-b723-016e170b24c3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:09.296973 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a66602f6-c112-4e55-b723-016e170b24c3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:09.297415 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a66602f6-c112-4e55-b723-016e170b24c3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:09.433614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-a66602f6-c112-4e55-b723-016e170b24c3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:09.441050 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a66602f6-c112-4e55-b723-016e170b24c3 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.157207 May 26 18:32:09.441616 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 511/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:09 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:10.458404 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-80df35ce-d0ec-463a-ad12-0bceb5bae730 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:10.459047 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-80df35ce-d0ec-463a-ad12-0bceb5bae730 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:10.466308 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80df35ce-d0ec-463a-ad12-0bceb5bae730 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:10.466761 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80df35ce-d0ec-463a-ad12-0bceb5bae730 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:10.467526 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80df35ce-d0ec-463a-ad12-0bceb5bae730 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:10.467964 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-80df35ce-d0ec-463a-ad12-0bceb5bae730 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:10.599219 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-80df35ce-d0ec-463a-ad12-0bceb5bae730 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:10.607403 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-80df35ce-d0ec-463a-ad12-0bceb5bae730 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.152883 May 26 18:32:10.607971 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 518/1029] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:10 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:11.624592 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-9ff63c97-a86b-4218-bd8b-239c39d5d4d8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:11.625247 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-9ff63c97-a86b-4218-bd8b-239c39d5d4d8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:11.631816 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9ff63c97-a86b-4218-bd8b-239c39d5d4d8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:11.632300 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9ff63c97-a86b-4218-bd8b-239c39d5d4d8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:11.633075 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9ff63c97-a86b-4218-bd8b-239c39d5d4d8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:11.633551 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-9ff63c97-a86b-4218-bd8b-239c39d5d4d8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:11.765590 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-9ff63c97-a86b-4218-bd8b-239c39d5d4d8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:11.773893 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-9ff63c97-a86b-4218-bd8b-239c39d5d4d8 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.152894 May 26 18:32:11.774491 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 512/1030] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:11 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:32:12.790765 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a503b3f2-d3b9-4b5a-9aaf-9910cc5b451b tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:12.791513 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a503b3f2-d3b9-4b5a-9aaf-9910cc5b451b tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:12.797957 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a503b3f2-d3b9-4b5a-9aaf-9910cc5b451b tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:12.798415 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a503b3f2-d3b9-4b5a-9aaf-9910cc5b451b tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:12.799194 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a503b3f2-d3b9-4b5a-9aaf-9910cc5b451b tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:12.799655 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a503b3f2-d3b9-4b5a-9aaf-9910cc5b451b tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:12.933547 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a503b3f2-d3b9-4b5a-9aaf-9910cc5b451b tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:12.941595 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a503b3f2-d3b9-4b5a-9aaf-9910cc5b451b tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.155375 May 26 18:32:12.942238 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 519/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:12 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:13.958718 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-42cdf1d7-e7e4-40bf-b508-9cf300567124 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:13.959400 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-42cdf1d7-e7e4-40bf-b508-9cf300567124 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:13.965952 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-42cdf1d7-e7e4-40bf-b508-9cf300567124 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:13.966409 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-42cdf1d7-e7e4-40bf-b508-9cf300567124 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:13.967180 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-42cdf1d7-e7e4-40bf-b508-9cf300567124 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:13.967623 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-42cdf1d7-e7e4-40bf-b508-9cf300567124 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:14.111729 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-42cdf1d7-e7e4-40bf-b508-9cf300567124 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:14.126377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-42cdf1d7-e7e4-40bf-b508-9cf300567124 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.171782 May 26 18:32:14.127044 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 513/1032] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:13 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:15.143987 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-ec12011f-a14b-467f-96f0-86229e606cd2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:15.144610 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-ec12011f-a14b-467f-96f0-86229e606cd2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:15.151882 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec12011f-a14b-467f-96f0-86229e606cd2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:15.152365 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec12011f-a14b-467f-96f0-86229e606cd2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:15.153133 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec12011f-a14b-467f-96f0-86229e606cd2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:15.153572 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-ec12011f-a14b-467f-96f0-86229e606cd2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:15.287622 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-ec12011f-a14b-467f-96f0-86229e606cd2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:15.295088 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-ec12011f-a14b-467f-96f0-86229e606cd2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.155003 May 26 18:32:15.295656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 520/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:15 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:32:16.312021 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-c97f40c5-adaa-448d-8e44-c248794a3100 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:16.312640 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-c97f40c5-adaa-448d-8e44-c248794a3100 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:16.315070 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=2 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:16.315733 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell0:SELECT=6 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:16.322207 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c97f40c5-adaa-448d-8e44-c248794a3100 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:16.322663 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c97f40c5-adaa-448d-8e44-c248794a3100 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:16.323443 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c97f40c5-adaa-448d-8e44-c248794a3100 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:16.323885 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-c97f40c5-adaa-448d-8e44-c248794a3100 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:16.457448 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-c97f40c5-adaa-448d-8e44-c248794a3100 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:16.465634 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-c97f40c5-adaa-448d-8e44-c248794a3100 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.157465 May 26 18:32:16.466237 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 514/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:16 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:17.482748 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-309f47e2-154f-4b9c-ac88-b6dbf196c485 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:17.483355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-309f47e2-154f-4b9c-ac88-b6dbf196c485 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:17.485252 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell0:SELECT=2 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:17.490945 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-309f47e2-154f-4b9c-ac88-b6dbf196c485 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:17.491396 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-309f47e2-154f-4b9c-ac88-b6dbf196c485 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:17.492165 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-309f47e2-154f-4b9c-ac88-b6dbf196c485 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:17.492598 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-309f47e2-154f-4b9c-ac88-b6dbf196c485 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:17.631904 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-309f47e2-154f-4b9c-ac88-b6dbf196c485 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:17.640780 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-309f47e2-154f-4b9c-ac88-b6dbf196c485 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.161924 May 26 18:32:17.641341 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 521/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:17 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:18.658475 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-2b3d5d28-8162-4d09-bfcd-b778c5803ded tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:18.659095 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-2b3d5d28-8162-4d09-bfcd-b778c5803ded tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:18.666650 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b3d5d28-8162-4d09-bfcd-b778c5803ded tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:18.666952 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b3d5d28-8162-4d09-bfcd-b778c5803ded tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:18.667723 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b3d5d28-8162-4d09-bfcd-b778c5803ded tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:18.668157 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-2b3d5d28-8162-4d09-bfcd-b778c5803ded tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:18.806569 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-2b3d5d28-8162-4d09-bfcd-b778c5803ded tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:18.814958 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-2b3d5d28-8162-4d09-bfcd-b778c5803ded tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.160365 May 26 18:32:18.815537 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 515/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:18 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:19.531276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-ebe00a04-5d0a-4098-bc34-101a17528495 req-1425ce66-6754-464e-ba43-a8f73dcaf205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359aeef4-2b65-4763-984b-ac8d32ea303e", "name": "network-vif-plugged", "status": "completed", "tag": "62721df7-b6e4-44fe-9d31-491e9808235d"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:32:19.541425 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ebe00a04-5d0a-4098-bc34-101a17528495 req-1425ce66-6754-464e-ba43-a8f73dcaf205 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:19.541967 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-ebe00a04-5d0a-4098-bc34-101a17528495 req-1425ce66-6754-464e-ba43-a8f73dcaf205 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:19.553840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-ebe00a04-5d0a-4098-bc34-101a17528495 req-1425ce66-6754-464e-ba43-a8f73dcaf205 service nova] Creating event network-vif-plugged:62721df7-b6e4-44fe-9d31-491e9808235d for instance 359aeef4-2b65-4763-984b-ac8d32ea303e on hv-cinder-84349 May 26 18:32:19.559733 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-ebe00a04-5d0a-4098-bc34-101a17528495 req-1425ce66-6754-464e-ba43-a8f73dcaf205 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032112 May 26 18:32:19.560499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 522/1037] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:32:19.832869 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-29f17509-2c41-4777-be41-36089424b697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:19.833411 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-29f17509-2c41-4777-be41-36089424b697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:19.840163 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29f17509-2c41-4777-be41-36089424b697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:19.840614 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29f17509-2c41-4777-be41-36089424b697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:19.841378 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29f17509-2c41-4777-be41-36089424b697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:19.841844 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-29f17509-2c41-4777-be41-36089424b697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:19.974522 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-29f17509-2c41-4777-be41-36089424b697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:19.982990 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-29f17509-2c41-4777-be41-36089424b697 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1265 microversion: 2.1 time: 0.154050 May 26 18:32:19.983559 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 516/1038] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:19 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:32:21.000304 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-2bcf9ab5-d7c9-4164-a18c-2161fbbe23d0 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:21.001060 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-2bcf9ab5-d7c9-4164-a18c-2161fbbe23d0 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:21.007301 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2bcf9ab5-d7c9-4164-a18c-2161fbbe23d0 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:21.007762 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2bcf9ab5-d7c9-4164-a18c-2161fbbe23d0 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:21.008531 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2bcf9ab5-d7c9-4164-a18c-2161fbbe23d0 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:21.009061 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-2bcf9ab5-d7c9-4164-a18c-2161fbbe23d0 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:21.143160 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-2bcf9ab5-d7c9-4164-a18c-2161fbbe23d0 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:21.150686 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-2bcf9ab5-d7c9-4164-a18c-2161fbbe23d0 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1452 microversion: 2.1 time: 0.155091 May 26 18:32:21.151285 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 523/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:20 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:21.167283 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-dd593b97-f3dc-4c40-a9dc-3a41dbb47e5d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:32:21.167894 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-dd593b97-f3dc-4c40-a9dc-3a41dbb47e5d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:32:21.174354 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd593b97-f3dc-4c40-a9dc-3a41dbb47e5d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:21.174798 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd593b97-f3dc-4c40-a9dc-3a41dbb47e5d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:21.175552 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd593b97-f3dc-4c40-a9dc-3a41dbb47e5d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:21.175979 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd593b97-f3dc-4c40-a9dc-3a41dbb47e5d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:21.311120 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-dd593b97-f3dc-4c40-a9dc-3a41dbb47e5d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:32:21.318923 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-dd593b97-f3dc-4c40-a9dc-3a41dbb47e5d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1452 microversion: 2.1 time: 0.155777 May 26 18:32:21.319809 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 517/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:32:21 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:32:23.322845 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-a1aa4e55-90ae-4fc5-b37f-fbf592cf7b84 req-7efa87cb-03ce-4526-b66e-198ff9066bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359aeef4-2b65-4763-984b-ac8d32ea303e", "tag": "62721df7-b6e4-44fe-9d31-491e9808235d"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:32:23.330990 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-a1aa4e55-90ae-4fc5-b37f-fbf592cf7b84 req-7efa87cb-03ce-4526-b66e-198ff9066bb3 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:32:23.331441 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-a1aa4e55-90ae-4fc5-b37f-fbf592cf7b84 req-7efa87cb-03ce-4526-b66e-198ff9066bb3 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:32:23.343491 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-a1aa4e55-90ae-4fc5-b37f-fbf592cf7b84 req-7efa87cb-03ce-4526-b66e-198ff9066bb3 service nova] Creating event network-changed:62721df7-b6e4-44fe-9d31-491e9808235d for instance 359aeef4-2b65-4763-984b-ac8d32ea303e on hv-cinder-84349 May 26 18:32:23.348711 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-a1aa4e55-90ae-4fc5-b37f-fbf592cf7b84 req-7efa87cb-03ce-4526-b66e-198ff9066bb3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174448 May 26 18:32:23.349330 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 524/1041] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:32:58.306864 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:32:58.307840 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Thu May 26 18:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:33:03.050546 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:33:03.051319 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Thu May 26 18:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:34:02.660626 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:02.661903 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG dbcounter [-] [117697] Writing DB stats nova_cell1:SELECT=52 {{(pid=117697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:02.664327 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_api:SELECT=20 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:02.665184 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG dbcounter [-] [117696] Writing DB stats nova_cell1:SELECT=40 {{(pid=117696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:02.666786 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-a6d62c5d-a43b-4c85-9a57-2677ddf671c2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:02.667527 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a6d62c5d-a43b-4c85-9a57-2677ddf671c2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:02.672152 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-82ffa4f0-120e-4f79-90fb-4da1a76c8314 req-6b2f3461-6037-4d78-ba66-6fda93568a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359aeef4-2b65-4763-984b-ac8d32ea303e", "tag": "62721df7-b6e4-44fe-9d31-491e9808235d"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:34:02.675398 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a6d62c5d-a43b-4c85-9a57-2677ddf671c2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:02.675852 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a6d62c5d-a43b-4c85-9a57-2677ddf671c2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:02.676624 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a6d62c5d-a43b-4c85-9a57-2677ddf671c2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:02.677176 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-a6d62c5d-a43b-4c85-9a57-2677ddf671c2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:02.683414 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-82ffa4f0-120e-4f79-90fb-4da1a76c8314 req-6b2f3461-6037-4d78-ba66-6fda93568a75 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:02.683414 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-82ffa4f0-120e-4f79-90fb-4da1a76c8314 req-6b2f3461-6037-4d78-ba66-6fda93568a75 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:02.694492 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-82ffa4f0-120e-4f79-90fb-4da1a76c8314 req-6b2f3461-6037-4d78-ba66-6fda93568a75 service nova] Creating event network-changed:62721df7-b6e4-44fe-9d31-491e9808235d for instance 359aeef4-2b65-4763-984b-ac8d32ea303e on hv-cinder-84349 May 26 18:34:02.699959 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-82ffa4f0-120e-4f79-90fb-4da1a76c8314 req-6b2f3461-6037-4d78-ba66-6fda93568a75 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038570 May 26 18:34:02.700709 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 525/1042] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:34:02.705452 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-a6d62c5d-a43b-4c85-9a57-2677ddf671c2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Going to try to terminate instance {{(pid=117697) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:34:02.800367 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-a6d62c5d-a43b-4c85-9a57-2677ddf671c2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "DELETE /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 204 len: 0 microversion: 2.1 time: 0.141307 May 26 18:34:02.804396 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 518/1043] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:34:02 2022] DELETE /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:34:02.809998 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-3b864ef7-5f13-4575-a9c9-af525e4e3775 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:02.811318 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-3b864ef7-5f13-4575-a9c9-af525e4e3775 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:02.819067 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3b864ef7-5f13-4575-a9c9-af525e4e3775 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:02.820079 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3b864ef7-5f13-4575-a9c9-af525e4e3775 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:02.821188 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3b864ef7-5f13-4575-a9c9-af525e4e3775 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:02.821934 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-3b864ef7-5f13-4575-a9c9-af525e4e3775 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:03.102495 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-3b864ef7-5f13-4575-a9c9-af525e4e3775 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:34:03.112853 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-3b864ef7-5f13-4575-a9c9-af525e4e3775 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1576 microversion: 2.1 time: 0.306958 May 26 18:34:03.113434 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 526/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:34:02 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1576 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:34:04.131574 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-6842b46e-6028-40ab-b350-fda3d31e325d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:04.132284 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-6842b46e-6028-40ab-b350-fda3d31e325d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:04.138838 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6842b46e-6028-40ab-b350-fda3d31e325d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:04.139991 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6842b46e-6028-40ab-b350-fda3d31e325d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:04.140922 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6842b46e-6028-40ab-b350-fda3d31e325d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:04.141422 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-6842b46e-6028-40ab-b350-fda3d31e325d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:04.486091 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-6842b46e-6028-40ab-b350-fda3d31e325d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:34:04.493638 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-6842b46e-6028-40ab-b350-fda3d31e325d tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 200 len: 1576 microversion: 2.1 time: 0.366407 May 26 18:34:04.494246 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 519/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:34:04 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 1576 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:34:04.826656 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [req-6ee5568c-da4e-4f22-99d0-28cfe771a2b4 req-d8bcc191-5173-4f72-9c61-5f2a39730fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359aeef4-2b65-4763-984b-ac8d32ea303e", "name": "network-vif-deleted", "tag": "62721df7-b6e4-44fe-9d31-491e9808235d"}]} {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:34:04.836039 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6ee5568c-da4e-4f22-99d0-28cfe771a2b4 req-d8bcc191-5173-4f72-9c61-5f2a39730fd7 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:04.836485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [req-6ee5568c-da4e-4f22-99d0-28cfe771a2b4 req-d8bcc191-5173-4f72-9c61-5f2a39730fd7 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:04.848477 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.compute.server_external_events [req-6ee5568c-da4e-4f22-99d0-28cfe771a2b4 req-d8bcc191-5173-4f72-9c61-5f2a39730fd7 service nova] Creating event network-vif-deleted:62721df7-b6e4-44fe-9d31-491e9808235d for instance 359aeef4-2b65-4763-984b-ac8d32ea303e on hv-cinder-84349 May 26 18:34:04.853575 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [req-6ee5568c-da4e-4f22-99d0-28cfe771a2b4 req-d8bcc191-5173-4f72-9c61-5f2a39730fd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030939 May 26 18:34:04.854210 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 527/1046] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:34:05.513570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:05.515045 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: 359aeef4-2b65-4763-984b-ac8d32ea303e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:05.521629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:05.522182 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:05.522959 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:05.523572 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:05.538200 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] HTTP exception thrown: Instance 359aeef4-2b65-4763-984b-ac8d32ea303e could not be found. May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Request method failure captured: May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e HTTP/1.1 May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8aUFrkHgrRh10SKb5gITkEKEuCcayjpgBgph1zzn_8s-WC6Lya6kwZ3NxMSWWqDDiUOBD65TFj_nKjRSv9at-v4mdAoPKKwSicvhREZtQEf_f97I-345GdNM5Vo7r_sW0-xmg0Y1TqAqL33wa_F99kIZ61wmlzXthdNgi1UcWKohow May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:34:05.539908 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6774c3ce4b094e19ad6da95e3744d9ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-TestVolumeBootPattern-527529841 May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-TestVolumeBootPattern-527529841-project May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 7cde3488be6c4c8790841b7529123326 May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-TestVolumeBootPattern-527529841-project May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance 359aeef4-2b65-4763-984b-ac8d32ea303e could not be found. May 26 18:34:05.541690 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': '359aeef4-2b65-4763-984b-ac8d32ea303e'} May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359aeef4-2b65-4763-984b-ac8d32ea303e could not be found. May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:34:05.542812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359aeef4-2b65-4763-984b-ac8d32ea303e could not be found. May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359aeef4-2b65-4763-984b-ac8d32ea303e could not be found. May 26 18:34:05.544549 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:05.546060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Returning 404 to user: Instance 359aeef4-2b65-4763-984b-ac8d32ea303e could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:34:05.546060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-dd9dc5ee-0236-4280-aa50-4e73053f5fa5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e" status: 404 len: 111 microversion: 2.1 time: 0.032090 May 26 18:34:05.546060 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 520/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:34:05 2022] GET /compute/v2.1/servers/359aeef4-2b65-4763-984b-ac8d32ea303e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:34:08.698020 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-c2e95546-7b4f-477e-a390-2213e4b97a45 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:08.698607 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c2e95546-7b4f-477e-a390-2213e4b97a45 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:08.703341 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-2b1300b5-0d6e-4e6f-8126-d05fea28da0a req-20fa77e9-07bb-4539-9c11-134887606752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22", "tag": "d90b241f-7d62-419a-b730-21988dd581c7"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:34:08.708991 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2e95546-7b4f-477e-a390-2213e4b97a45 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:08.709819 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2e95546-7b4f-477e-a390-2213e4b97a45 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:08.711105 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2e95546-7b4f-477e-a390-2213e4b97a45 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:08.712310 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-c2e95546-7b4f-477e-a390-2213e4b97a45 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:08.714957 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-2b1300b5-0d6e-4e6f-8126-d05fea28da0a req-20fa77e9-07bb-4539-9c11-134887606752 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:08.715563 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-2b1300b5-0d6e-4e6f-8126-d05fea28da0a req-20fa77e9-07bb-4539-9c11-134887606752 service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:08.738799 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-2b1300b5-0d6e-4e6f-8126-d05fea28da0a req-20fa77e9-07bb-4539-9c11-134887606752 service nova] Creating event network-changed:d90b241f-7d62-419a-b730-21988dd581c7 for instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 on hv-cinder-84349 May 26 18:34:08.745159 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-2b1300b5-0d6e-4e6f-8126-d05fea28da0a req-20fa77e9-07bb-4539-9c11-134887606752 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047827 May 26 18:34:08.746377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 521/1048] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:34:08.753679 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-c2e95546-7b4f-477e-a390-2213e4b97a45 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Going to try to terminate instance {{(pid=117696) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:34:08.863649 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-c2e95546-7b4f-477e-a390-2213e4b97a45 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 204 len: 0 microversion: 2.1 time: 0.167035 May 26 18:34:08.863649 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 528/1049] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:34:08 2022] DELETE /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:34:08.875745 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-e27afe02-8327-4f2f-aa7a-626556dc7277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:08.877000 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-e27afe02-8327-4f2f-aa7a-626556dc7277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:08.884248 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e27afe02-8327-4f2f-aa7a-626556dc7277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:08.884701 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e27afe02-8327-4f2f-aa7a-626556dc7277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:08.885480 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e27afe02-8327-4f2f-aa7a-626556dc7277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:08.885961 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-e27afe02-8327-4f2f-aa7a-626556dc7277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:09.058346 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.policy [None req-e27afe02-8327-4f2f-aa7a-626556dc7277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117697) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:34:09.067280 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-e27afe02-8327-4f2f-aa7a-626556dc7277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1577 microversion: 2.1 time: 0.196994 May 26 18:34:09.067979 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 522/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:34:08 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:34:10.085208 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-a029f77c-9f32-4ae1-8bb1-b5dc3b7cc11e tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:10.085946 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-a029f77c-9f32-4ae1-8bb1-b5dc3b7cc11e tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:10.093052 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a029f77c-9f32-4ae1-8bb1-b5dc3b7cc11e tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:10.093500 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a029f77c-9f32-4ae1-8bb1-b5dc3b7cc11e tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:10.094411 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a029f77c-9f32-4ae1-8bb1-b5dc3b7cc11e tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:10.094845 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-a029f77c-9f32-4ae1-8bb1-b5dc3b7cc11e tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:10.680586 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.policy [None req-a029f77c-9f32-4ae1-8bb1-b5dc3b7cc11e tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cde3488be6c4c8790841b7529123326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6774c3ce4b094e19ad6da95e3744d9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117696) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:34:10.688668 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-a029f77c-9f32-4ae1-8bb1-b5dc3b7cc11e tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 200 len: 1577 microversion: 2.1 time: 0.607719 May 26 18:34:10.689387 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 529/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:34:10 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 1577 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:34:11.011264 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [req-65054419-da14-4552-982c-39c6dcf4c2f2 req-e312435c-9f30-4076-a866-de5ff22d6dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22", "name": "network-vif-deleted", "tag": "d90b241f-7d62-419a-b730-21988dd581c7"}]} {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:34:11.021629 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-65054419-da14-4552-982c-39c6dcf4c2f2 req-e312435c-9f30-4076-a866-de5ff22d6dbc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:11.022127 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [req-65054419-da14-4552-982c-39c6dcf4c2f2 req-e312435c-9f30-4076-a866-de5ff22d6dbc service nova] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:11.034812 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.compute.server_external_events [req-65054419-da14-4552-982c-39c6dcf4c2f2 req-e312435c-9f30-4076-a866-de5ff22d6dbc service nova] Creating event network-vif-deleted:d90b241f-7d62-419a-b730-21988dd581c7 for instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 on hv-cinder-84349 May 26 18:34:11.040738 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [req-65054419-da14-4552-982c-39c6dcf4c2f2 req-e312435c-9f30-4076-a866-de5ff22d6dbc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 May 26 18:34:11.041392 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 523/1052] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 18:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:34:11.706213 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:11.706860 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:11.713369 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:11.713867 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:11.714636 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:11.715083 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:11.729200 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] HTTP exception thrown: Instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 could not be found. May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Request method failure captured: May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 HTTP/1.1 May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8aUFrkHgrRh10SKb5gITkEKEuCcayjpgBgph1zzn_8s-WC6Lya6kwZ3NxMSWWqDDiUOBD65TFj_nKjRSv9at-v4mdAoPKKwSicvhREZtQEf_f97I-345GdNM5Vo7r_sW0-xmg0Y1TqAqL33wa_F99kIZ61wmlzXthdNgi1UcWKohow May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:34:11.730883 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6774c3ce4b094e19ad6da95e3744d9ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-TestVolumeBootPattern-527529841 May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-TestVolumeBootPattern-527529841-project May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 7cde3488be6c4c8790841b7529123326 May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-TestVolumeBootPattern-527529841-project May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 could not be found. May 26 18:34:11.732605 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22'} May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 could not be found. May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:34:11.734485 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 could not be found. May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 could not be found. May 26 18:34:11.736013 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:11.737522 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Returning 404 to user: Instance a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:34:11.737522 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-742fa99b-efe4-42f1-82ca-7515878ae277 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22" status: 404 len: 111 microversion: 2.1 time: 0.030233 May 26 18:34:11.737522 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 530/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:34:11 2022] GET /compute/v2.1/servers/a39d2a2d-7e0d-4070-a5a7-0f3c6b10bd22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:34:12.173705 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:12.174327 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.compute.api [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117697) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:12.181283 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:12.181752 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:12.182547 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:12.182989 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG oslo_concurrency.lockutils [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:12.196380 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.wsgi [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] HTTP exception thrown: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Request method failure captured: May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: request: DELETE /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e HTTP/1.1 May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept: application/json May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Accept-Encoding: identity May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Connection: close May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Length: 0 May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Content-Type: application/json May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Host: 10.222.0.46 May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Openstack-System-Scope: None May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: User-Agent: python-urllib3/1.26.9 May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Auth-Token: gAAAAABij8aUFrkHgrRh10SKb5gITkEKEuCcayjpgBgph1zzn_8s-WC6Lya6kwZ3NxMSWWqDDiUOBD65TFj_nKjRSv9at-v4mdAoPKKwSicvhREZtQEf_f97I-345GdNM5Vo7r_sW0-xmg0Y1TqAqL33wa_F99kIZ61wmlzXthdNgi1UcWKohow May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Id: None May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Domain-Name: None May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Identity-Status: Confirmed May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Is-Admin-Project: True May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Id: default May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Domain-Name: Default May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Project-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Role: member,reader May 26 18:34:12.198063 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Roles: member,reader May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6774c3ce4b094e19ad6da95e3744d9ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant: tempest-TestVolumeBootPattern-527529841 May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-Tenant-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User: tempest-TestVolumeBootPattern-527529841-project May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Id: default May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Domain-Name: Default May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Id: 7cde3488be6c4c8790841b7529123326 May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: X-User-Name: tempest-TestVolumeBootPattern-527529841-project May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: method: > May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: exception: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.199570 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: action_args: {'id': 'b5f76001-148d-4c5f-a8b8-a1f881a6033e'} May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:34:12.200358 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.201874 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR nova.api.openstack.wsgi May 26 18:34:12.203322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Returning 404 to user: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. {{(pid=117697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:34:12.203322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-85baa213-52ee-45fa-bf4c-8fb1a70f2fb2 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 404 len: 111 microversion: 2.1 time: 0.031806 May 26 18:34:12.203322 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 524/1054] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 18:34:12 2022] DELETE /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:34:12.208276 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '>' {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:12.208897 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.compute.api [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [instance: b5f76001-148d-4c5f-a8b8-a1f881a6033e] Fetching instance by UUID {{(pid=117696) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:34:12.215009 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:12.215463 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:12.216229 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:34:12.216667 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG oslo_concurrency.lockutils [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Lock "34292359-78bc-40ed-8211-94bb149a5ad8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:34:12.230957 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.wsgi [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] HTTP exception thrown: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Request method failure captured: May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: request: GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e HTTP/1.1 May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept: application/json May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Accept-Encoding: identity May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Connection: close May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Length: 0 May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Content-Type: application/json May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Host: 10.222.0.46 May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Openstack-System-Scope: None May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: User-Agent: python-urllib3/1.26.9 May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Auth-Token: gAAAAABij8aUFrkHgrRh10SKb5gITkEKEuCcayjpgBgph1zzn_8s-WC6Lya6kwZ3NxMSWWqDDiUOBD65TFj_nKjRSv9at-v4mdAoPKKwSicvhREZtQEf_f97I-345GdNM5Vo7r_sW0-xmg0Y1TqAqL33wa_F99kIZ61wmlzXthdNgi1UcWKohow May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Id: None May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Domain-Name: None May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Identity-Status: Confirmed May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Is-Admin-Project: True May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Id: default May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Domain-Name: Default May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Project-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Role: member,reader May 26 18:34:12.232484 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Roles: member,reader May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6774c3ce4b094e19ad6da95e3744d9ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6774c3ce4b094e19ad6da95e3744d9ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}] May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant: tempest-TestVolumeBootPattern-527529841 May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Id: 6774c3ce4b094e19ad6da95e3744d9ed May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-Tenant-Name: tempest-TestVolumeBootPattern-527529841 May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User: tempest-TestVolumeBootPattern-527529841-project May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Id: default May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Domain-Name: Default May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Id: 7cde3488be6c4c8790841b7529123326 May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: X-User-Name: tempest-TestVolumeBootPattern-527529841-project May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: method: > May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: exception: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.234917 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: action_args: {'id': 'b5f76001-148d-4c5f-a8b8-a1f881a6033e'} May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: {{(pid=117696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:34:12.235787 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. May 26 18:34:12.237333 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: ERROR nova.api.openstack.wsgi May 26 18:34:12.239612 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: DEBUG nova.api.openstack.wsgi [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Returning 404 to user: Instance b5f76001-148d-4c5f-a8b8-a1f881a6033e could not be found. {{(pid=117696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:34:12.239612 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO nova.api.openstack.requestlog [None req-86170593-2b29-40f2-87ef-004e5dfaf3c5 tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e" status: 404 len: 111 microversion: 2.1 time: 0.030196 May 26 18:34:12.239612 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: [pid: 117696|app: 0|req: 531/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 18:34:12 2022] GET /compute/v2.1/servers/b5f76001-148d-4c5f-a8b8-a1f881a6033e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:34:13.533720 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: DEBUG nova.api.openstack.wsgi [None req-0629522b-c7e5-4c52-8b7e-95680f98683a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] Calling method '.version_select at 0x7f5f18e7c1f0>' {{(pid=117697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:34:13.537234 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0629522b-c7e5-4c52-8b7e-95680f98683a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [a1a9631b-ecc5-4b41-8f5d-569e728ec8db] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 18:34:14.544507 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO oslo.messaging._drivers.impl_rabbit [None req-0629522b-c7e5-4c52-8b7e-95680f98683a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] [a1a9631b-ecc5-4b41-8f5d-569e728ec8db] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 43272. May 26 18:34:14.563785 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO nova.api.openstack.requestlog [None req-0629522b-c7e5-4c52-8b7e-95680f98683a tempest-TestVolumeBootPattern-527529841 tempest-TestVolumeBootPattern-527529841-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2004287902" status: 202 len: 0 microversion: 2.1 time: 1.034605 May 26 18:34:14.564377 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: [pid: 117697|app: 0|req: 525/1056] 10.222.0.46 () {58 vars in 1262 bytes} [Thu May 26 18:34:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2004287902 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:36:18.315614 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:36:18.316241 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Thu May 26 18:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:36:23.058756 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:36:23.059499 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Thu May 26 18:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:36:35.102584 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:36:35.103180 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Thu May 26 18:36:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:37:44.408032 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:37:44.408773 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Thu May 26 18:37:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:39:30.501678 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:39:30.502474 dv-cinder-843493-1-iscsi devstack@n-api.service[117697]: Thu May 26 18:39:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:39:38.325809 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:39:38.326355 dv-cinder-843493-1-iscsi devstack@n-api.service[117696]: Thu May 26 18:39:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!